Data Engineer Job at Drw, Chicago, IL

b0NPaCs0Y1gyYjhYYVhySGRSZlBoTVM1aVE9PQ==
  • Drw
  • Chicago, IL

Job Description

 

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.

Headquartered in Chicago with offices throughout the U.S., Canada, Europe, and Asia, we trade a variety of asset classes including Fixed Income, ETFs, Equities, FX, Commodities and Energy across all major global markets. We have also leveraged our expertise and technology to expand into three non-traditional strategies: real estate, venture capital and cryptoassets.

We operate with respect, curiosity and open minds. The people who thrive here share our belief that it’s not just what we do that matters–it's how we do it.  DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus.

 

As a Data Engineer in our Unified Platform organization, you will play an integral role in building data products and defining platform capabilities used by Traders, Quantitative Researchers, and Back-Office personnel to analyze financial markets, determine trading opportunities, establish new strategies, and ensure smooth back-office processes.  

Technical requirements summary:  


  • Have experience designing and building data pipelines and systems

  • Have experience working within modern batch or streaming data ecosystems

  • An expert in SQL and have expertise in Java/Scala or Python

  • Can apply data modeling techniques

  • Able to own the delivery of data projects, working with analysts and stakeholders to understand requirements and implement solutions

  • Able to contribute to project management and project reporting  

What you will do in this role:  


  • Help model, build, and manage data products built atop DRW’s Unified Data Platform.

  • Work alongside domain experts to gain and leverage knowledge of the relevant project’s domain to design optimized data products that meet the needs of many different research and trading strategies.

  • Work closely with Traders and Researchers to determine appropriate data sources and implement processes to onboard and manage new data sources for analysis to unlock future trading opportunities.

  • Design and develop data solutions to help discover, purchase, organize, track usage, manage rights, and control quality of data sets to address the needs of various DRW trading teams and strategies.

  • Continually monitor data ingestion pipelines and data quality to ensure stability, reliability, and quality of the data. Contribute to the monitoring and quality control software and processes.  

What you will need in this role:  


  • 3+ years of experience working with modern data technologies and/or building data-first products

  • Extensive familiarity with SQL with a proven ability to construct maintainable queries and productionalize them as ongoing pipelines.

  • Experience leveraging data modeling techniques on complex datasets and ability to articulate the trade-offs of different approaches.

  • Strong skill in Java/Scala or Python

  • Familiarity with cloud-native technologies used for scalable data processing.

  • Experience with one or more data processing technologies (e.g. Flink, Spark, Polars, Dask, etc.)

  • Experience with multiple data storage technologies (e.g. S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.) and knowledge of their associated trade-offs.

  • Experience with multiple data formats and serialization systems (e.g. Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.)

  • Experience managing data pipeline orchestration systems (e.g. Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.)

  • Proven experience in managing the operational components of large data pipelines such as backfilling datasets, rerunning batch jobs, and handling dead letter queues.

  • Prior experience triaging data quality control processes, correcting data gaps and inaccuracies.

  • Strong technical problem-solving skills

  • Proven ability to work in a collaborative, agile, and fast-paced environment, prioritizing multiple tasks and projects, and efficiently handle the demands of a trading environment

  • Excellent written and verbal communication skills.  

Location: Chicago or New York

The annual base salary range for this position is $150,000 to $200,000 depending on the candidate’s experience, qualifications, and relevant skill set. The position is also eligible for an annual discretionary bonus. In addition, DRW offers a comprehensive suite of employee benefits including group medical, pharmacy, dental and vision insurance, 401k (with discretionary employer match), short and long-term disability, life and AD&D insurance, health savings accounts, and flexible spending accounts.

For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at .

California residents, please review the California Privacy Notice for information about certain legal rights at  .

Job Tags

Full time, Temporary work, Flexible hours,

Similar Jobs

ProMedica Health System

Physician - Neurotologist Job at ProMedica Health System

 ...ProMedica Physicians Group (PPG) is currently seeking a Neurotologist to join our ENT practice at the ProMedica Health and Wellness Center in Sylvania, OH. Monday - Friday clinic schedule with no weekend requirements Opportunity to take paid call available but not required... 

University of Miami

Level I Registered Nurse (RN) - Oncology Job at University of Miami

 ...Job Description University of Miami is seeking a Registered Nurse (RN) Oncology Level I for a nursing job in Miami, Florida. Job...  ...certification from the American Heart Association required. Experience: No experience required. Knowledge, Skills and... 

Medical Solutions Allied

Travel CT Technologist (Siemens CT, Level I Trauma) - $3,053 per week Job at Medical Solutions Allied

Medical Solutions Allied is seeking a travel CT Technologist for a travel job in Boston, Massachusetts. Job Description & Requirements ~ Specialty: CT Technologist ~ Discipline: Allied Health Professional ~ Duration: 13 weeks ~36 hours per week ~ Shift: ...

C&G Consulting Services, Inc

Technical Writer Job at C&G Consulting Services, Inc

 ...accountabilities: o Responsible for the initiation, investigation and completion of Minor process deviations o Demonstrates technical writing for the educated but uninformed reader, translate simple to moderate scientific events into a brief and cohesive report as... 

Fanduel

Staff Data Engineer Job at Fanduel

 ...ABOUT FANDUEL FanDuel Group is the premier mobile gaming company in the United States and Canada. FanDuel Group consists of a portfolio of leading brands across mobile wagering including: Americas #1 Sportsbook, FanDuel Sportsbook; its leading iGaming platform, FanDuel...