Data engineer
3 days ago
Data Engineer - Quant TradingAbout Deeter InvestmentsDeeter Investments is a founder‑led proprietary trading firm built around real‑time, data‑driven decision‑making.We prize curiosity, collaboration, and a bias for action. After years of discretionary success, we’re launching a dedicated algorithmic division.Role DescriptionAs our first Data Engineer, you’ll own critical datasets end-to-end from ingestion and system architecture to reliability and access.You'll be designing, building, and running the data backbone for our algorithmic team.You’ll work directly with traders and researchers to turn messy external feeds into high-performance, well-structured datasets that guide decisions in research and production.Key Responsibilities- Architect cloud-native batch and streaming ELT for diverse sources; standardize, de-duplicate, document; define schemas and redundancy.- Stand up core platform: storage/lakehouse, orchestration, metadata/catalog, CI/CD, Ia C, observability; keep it simple and cost-aware.- Implement data quality checks, anomaly detection; maintain survivorship-bias-free histories and handle corporate actions/entitlements.- Expose clean data via APIs/query layers and shared libs; produce “research-ready” datasets for fast backtests and production.- Partner with quants/DS/SWE to scope, prototype, and productionize new datasets quickly; own incident response and runbooks.- Uphold security and access hygiene (IAM/least-privilege, secrets, audit).Qualifications & Experience- 5+ years building and operating production data pipelines/platforms (or equivalent).- Strong Python and SQL; ideally familiarity with distributed, time-series, or No SQL databases.- Comfortable on at least one major cloud (AWS/GCP/Azure).- Docker and Terraform (or similar).- Orchestration (e.g. Airflow/Prefect/Dagster), distributed/batch compute (e.g. Spark/Dask/Beam), warehouses/lakes, columnar formats (e.g. Parquet/Delta/Iceberg).- Monitoring/observability (logs/metrics/traces) and cost management.- Proven delivery for quantitative users or ML/DS teams; clear thinking, clean design, pragmatic trade-offs.Nice to Have- Financial/time-series data (corporate actions, vendor entitlements/licensing), alternative data ingestion.- Multimodal ETL (NLP/embeddings, transcription, basic image/video processing).- Dataset/version control and reproducibility (e.g., Lake FS/DVC) and research workflow tooling.Location: Remote Language: English requiredEmployment: Full-time
-
Data Engineer
7 days ago
Bareilly, India Tata Consultancy Services Full timeOpening - PUNE/Bangalore/Hyd/Chennai About the Role Role - Data Engineer - Quantexa ,Big Data Hadoop, Spark and Scala Responsibilities - Develop Spark and SCALA code as per requirement. - Build efficient and optimized ETLs for data ingestion/transformations. - Should be able to customize and update the Quantexa UI as per business requirement. - Documentation...
-
Data engineer
5 days ago
Bareilly, India People Prime Worldwide Full timeAbout Company:Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the...
-
Data Engineer — Microsoft Fabric
7 days ago
Bareilly, India VentraGate Full timeCompany Description VentraGate is a Cloud-focused solutions and services firm that excels in imagining, building, and sustaining digital transformation and cloud-based technologies. As a leading transformation consultancy, VentraGate helps enterprises of all sizes to become fast, agile, and competitive. Our team is dedicated to delivering innovative...
-
Data Engineer
7 days ago
Bareilly, India Sapaad Full timeWHO WE ARE Sapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day. Driven by a...
-
Python AWS Data Engineer
4 weeks ago
Bareilly, India Digitrix Software LLP Full timeExperience: 5 to 8 yearsJob description: Python AWS Data EngineerPython, AWS Python (core language skill) -- Backend, Pandas, PySpark (DataFrame API), interacting with AWS (e.g., boto3 for S3, Glue, Lambda)Data Processing: Spark (PySpark), Glue, EMR AWS Core Services: S3, Glue, Athena, Lambda, Step Functions, EMRContainerization: DockerOrchestration:...
-
Data Engineer
4 weeks ago
Bareilly, India BayRock Labs Full timeJob Title: Technical Analyst Experience: 5–6 yearsLocation: BangaloreResponsibilities:Write advanced Python code for data transformation and loading.Design and maintain data pipelines using dimensional models and star schema.Build and manage CI/CD pipelines for automated deployment.Debug and resolve issues in data pipelines and workflows.Required...
-
Senior data engineer
5 days ago
Bareilly, India USEReady Full timeDesignation: Senior Data EngineerLocation: India(Remote)Roles and Responsibilities:As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment.In this role, you will be a key contributor to the implementation of Snowflake with DBT, as part of our Migration from Oracle to a cloud-based data...
-
Senior data engineer
5 days ago
Bareilly, India Mitra AI Full timeWe are seeking a candidate who is comfortable working on B shift (3 PM - 11 PM IST).JOB SPECIFIC DUTIES AND RESPONSIBILITIESDevelop and maintain ETL pipelines using Five Tran, DBT Cloud, and custom frameworksImplement client-specific data transformations for High Touch integrationSupport data ingestion and quality checks during client onboardingOptimize...
-
Senior data scientist
3 days ago
Bareilly, India Recro Full timeAbout the jobRole : Senior Data Scientist (AI & Data)Location: Remote (Work from Home)We’re hiring a Senior Data Scientist to build the next generation of intelligentdecision systems that power pricing, supply optimization, ranking, and personalizationin our global B2 B hotel marketplace.This is a high-impact role at the intersection of machine learning,...
-
Senior Data Scientist
1 week ago
Bareilly, India Analyttica Datalab Full timeSenior Data ScientistLocation: BangaloreAbout the RoleWe are seeking a Senior Data Scientist with deep expertise in data science methodologies and exceptional proficiency in Python. You will lead end-to-end analytical initiatives — from problem framing and data preparation to model development, validation, deployment, and monitoring. This role requires...