Senior Member, Data Engineering (Macro)
Location
Bengaluru or Gurugram
Job Type
Full-Time
Experience Level
Associate level (1-3 Years)
Salary Range
Not disclosed
Job Description
We are looking for an experienced data engineer to join our Macro Tech team at our firm’s office in either of Bengaluru or Gurugram. As part of the role, you will own the lifecycle of complex, high-volume, non-standard market datasets used across a Macro trading business. You will be responsible for data acquisition workflows, building robust data quality controls, and partnering with engineers to deliver clean, reliable datasets through internal libraries/APIs to Quants, Traders, and Analysts. What you’ll do day-to-day You will own data pipelines end-to-end; from acquisition to ingestion to validation to publishing/vending. You will engage in data quality engineering by designing automated checks (completeness, timeliness, outliers, cross-source consistency), creating SOPs for daily checks, and building incident workflows. You will be a part of dataset onboarding which includes evaluating new datasets/vendors, coordinating with acquisition/extract teams, and stand-up production pipelines quickly and safely. You will handle stakeholder engagement by proactively communicating data issues, quality metrics, release changes, and known limitations to end users. You will utilize tooling and optimization where you will evaluate and apply data quality frameworks, workflow orchestration, monitor/alert, and improve pipeline efficiency over time. Also, you will partner with developers and co-own data vending layers (APIs/libraries), data contracts, and versioning to support research and production systems. Basic qualifications: A master’s or bachelor’s degree in computer science or a related technical field 2-4 years of relevant data engineering industry experience Solid understanding of data pipeline fundamentals (batch/stream, idempotency, backfills, late data, partitioning etc.) Exceptional problem-solving abilities and the capacity to acquire and apply new technologies quickly Excellent communication and ownership mindset Excellent attention to details and learning agility Preferred Qualifications: Work experience in a global and diverse team Work experience in market finance space
About D. E. Shaw India Private Limited
D. E. Shaw India Private Limited (D. E. Shaw India) is a part of the D. E. Shaw group, a global investment and technology development firm. Established in 1996 as a technological development center, D. E. Shaw India has expanded its business into a broad range of software and financial activities. Its staff collaborates with colleagues around the world not only to build cutting-edge proprietary software systems that form an important part of the D. E. Shaw group’s investment activities but also to provide research and operations support to the firm’s systematic, discretionary, and hybrid strategies. An entrepreneurial spirit has always been a part of D. E. Shaw India’s culture. When external platforms don’t meet our needs, we build our own. We created one of the first NoSQL databases in our industry, built a powerful data analysis library for Python before pandas existed, and built a modern web engineering framework tailored to the firm’s needs. This profile and any links posted through this profile (together, the “Content”) are provided for your information only and do not convey investment advice or an offer of any type with respect to any securities or other financial products. The D. E. Shaw group does not endorse any information or beliefs discussed in any links posted through this profile and makes no representation as to the accuracy or adequacy of the Content. The Content has not been updated for any information that may have changed since publication. No assurances can be given that any aims, assumptions, or expectations expressed or implied in the Content were or will be realized, or that the activities described have continued or will continue at all or in the same manner as described.
Connections
Sai Charan
Senior Developer
Kalpana Sharma
Team Lead
Rahul Patel
Full Stack Developer
Priya Singh
Frontend Developer
Connect with professionals in your network
Skill Match Analysis
??% skills matched (?? of 21 skills)
💡 This is keyword matching for reference only. Your actual match score uses AI semantic analysis.
Login to see your score