Data Engineer for Scalable Market Data Infrastructure

4 days ago


Delhi, Delhi, India Luxoft Full time
Job Description

We are seeking an experienced Data Engineer to design and develop a scalable data collection, storage, and distribution platform for market data projects.

The successful candidate will have a strong background in building greenfield data platforms running on Snowflake and AWS. They will work closely with the team to understand existing pipelines and enhance them for new requirements.

Key Responsibilities:
  • Develop web scraping scripts using APIs and tools to collect market data from various sources.
  • Collaborate with the team to build and maintain the data platform, ensuring seamless integration with existing systems.
  • Understand and improve data migration projects to ensure efficient data transfer.
  • Onboard new data providers to expand the data offerings.
Mandatory Skills and Qualifications:
  • Proficient in SQL, Python, Linux, and containerization technologies such as Docker and Kubernetes.
  • Strong understanding of DevOps practices, including Jenkins and Kubernetes.
  • Familiarity with AWS services, including storage and computing options.
  • Excellent communication skills and ability to work collaboratively.
Nice-to-Have Skills:
  • Experience working on market data projects or in capital markets.
  • Familiarity with Snowflake and Airflow is a plus.
Compensation and Benefits:

We offer a competitive salary range of $140,000 - $180,000 per year, depending on experience.

Luxoft provides a comprehensive benefits package, including health insurance, retirement plans, and paid time off.

About Luxoft:

Luxoft is a leading software development company that delivers innovative solutions to clients worldwide.


  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India Wellthy Therapeutics Pvt ltd Full time

    Join Wellthy Therapeutics as a Senior Data Engineer Wellthy Therapeutics is seeking a highly skilled Senior Data Engineer to join our team. As a key player in shaping our data architecture, you will be responsible for designing and implementing scalable data infrastructure solutions that meet our business needs. About the RoleWe are looking for a seasoned...


  • Delhi, Delhi, India StarTree Full time

    Company OverviewStarTree is a cloud-based software company that enables business customers to derive advanced insights from real-time and historical data.The company was founded by the core software engineering team and inventors of Apache Pinot, which currently powers hundreds of user-facing applications at companies across industries, including LinkedIn,...

  • Network Engineer

    2 weeks ago


    Delhi, Delhi, India NTT DATA Full time

    About the RoleThe Networking Managed Services Engineer (L2) at NTT DATA is a developing engineering position responsible for delivering proactive managed services to clients, ensuring their IT infrastructure and systems remain operational. This includes monitoring, identifying, investigating, and resolving technical incidents and problems while restoring...


  • Delhi, Delhi, India Kloud9 Full time

    Job OverviewKloud9 is seeking a highly skilled Data Engineering Technical Architect to lead the design and implementation of scalable, high-performance data lake solutions. The ideal candidate will have extensive experience in building data ingestion pipelines, managing big data processing using Apache Spark, and integrating SAP S/4HANA with GCP cloud...


  • Delhi, Delhi, India NTT DATA Full time

    About the Role:The Managed Services Cross Technology Engineer (L1) is a critical entry-level engineering position within NTT DATA, focused on providing proactive managed services to clients to ensure their IT infrastructure and systems remain operational.Key Responsibilities:Monitor client infrastructure and solutions to identify potential issues before they...

  • Data Engineer

    4 days ago


    Delhi, Delhi, India Luxoft Full time

    Project OverviewWe are seeking a highly skilled Data Operations Engineer to develop and maintain our scalable data collection, storage, and distribution platform. The successful candidate will be responsible for making data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance.Key Responsibilities:Design and...


  • Delhi, Delhi, India Luxoft Full time

    Project Overview:Luxoft is seeking a highly skilled Data Engineer to lead the development of a scalable data collection, storage, and distribution platform. The successful candidate will be responsible for designing and implementing a cutting-edge solution that integrates data from various vendors, research providers, exchanges, PBs, and web-scraping...


  • Delhi, Delhi, India HT Digital Streams Full time

    About the Role: We are seeking a highly experienced and motivated Head of Data Engineering to lead our data engineering team at HT Digital Streams. You will be responsible for building and scaling our data infrastructure to support our rapidly growing business.The ideal candidate is a passionate leader with a deep understanding of data engineering principles...


  • Delhi, Delhi, India HiPaaS Inc. Full time

    About UsHiPaaS Inc. is a leading provider of innovative data solutions.Job OverviewWe are seeking an experienced Data Engineer to join our team and contribute to the development of cutting-edge data infrastructure.Estimated Salary: $140,000 - $170,000 per yearResponsibilitiesDesign and build production-ready data pipelines and datasetsDevelop expertise in...


  • Delhi, Delhi, India ThinkMove Solutions Full time

    Salary : 14 - 18 LPA Overview :We are seeking an experienced Lead Data Architect to spearhead the design and implementation of our data infrastructure, with a focus on leveraging DataBricks for data processing and analytics. As a key member of our dynamic team, you will play a crucial role in architecting and optimizing our data pipeline and analytics...


  • Delhi, Delhi, India NTT DATA Full time

    Unlock the Power of IT with NTT DATAAbout the Role:The Networking Managed Services Engineer (L2) plays a crucial part in ensuring the smooth operation of our clients' IT infrastructure and systems. As a key member of our team, you will be responsible for providing a managed service to clients, proactively monitoring, identifying, investigating, and resolving...


  • Delhi, Delhi, India FLYONIT Full time

    Job Title: AWS Data EngineerWe are seeking a highly skilled AWS Data Engineer to join our dynamic team at FLYONIT. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud.Design, develop, and maintain scalable data...


  • Delhi, Delhi, India GIOS Technology Full time

    We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at GIOS Technology in Hyderabad, India. As a key member of our data engineering team, you will be responsible for designing and implementing scalable cloud infrastructure on Google Cloud Platform (GCP) using Terraform.Key Responsibilities:Automate GCP Infrastructure: Design and...


  • Delhi, Delhi, India Hevo Data Full time

    About Hevo DataWe are a cutting-edge data integration platform that empowers businesses to unlock the full potential of their data.Salary: $70,000 - $100,000 per annumJob DescriptionWe are seeking an exceptional Business Development Representative to join our team. As a key member of our sales organization, you will play a critical role in identifying and...


  • Delhi, Delhi, India Frontline Data Solutions Full time

    About Frontline Data SolutionsFrontline Data Solutions is a leading provider of web-based environmental, health, and safety software to the chemical, oil & gas, and manufacturing industries. Our company culture combines the agility of a startup with the stability of a 25-year-old industry leader.Job SummaryWe are seeking an experienced Senior Network...


  • Delhi, Delhi, India GAVS TECHNOLOGIES PRIVATE LIMITED Full time

    We are seeking a highly skilled Data Engineer to design, implement and maintain scalable ETL jobs and data pipelines for processing and analyzing large data sets.The ideal candidate will have strong experience with AWS services related to data engineering such as Glue, S3, Athena, Lambda, Kinesis, MSK, EventBridge, etc.A deep understanding of backend...


  • Delhi, Delhi, India SourceBae Full time

    About the Role: We're seeking a highly skilled Senior Data Infrastructure Engineer to join our team at SourceBae. As a key member of our Data Engineering team, you will be responsible for designing, building, and maintaining a secure, scalable, and reliable data platform that powers our Enterprise Data Hub.Key Responsibilities:• Design and architect...


  • Delhi, Delhi, India Recro Full time

    We are seeking a highly skilled Senior Data Infrastructure Specialist to join our team at Recro. In this role, you will be responsible for designing and building scalable data pipelines using AWS services such as Glue, Redshift/Spectrum, S3, API Gateway, and Athena.Key ResponsibilitiesArchitecting Data Pipelines: Utilize AWS services to create efficient and...

  • Data Engineer

    3 weeks ago


    Delhi, Delhi, India TransOrg Analytics Full time

    Data EngineerJob DescriptionAt TransOrg Analytics, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines using Azure Data Factory and Databricks workflows. You will also implement and manage big data solutions using Azure Databricks, design...


  • Delhi, Delhi, India NTT DATA Full time

    Job OverviewThe Security Managed Services Engineer (L2) at NTT DATA plays a critical role in ensuring the security and integrity of our clients' infrastructure and systems. As a key member of our managed services team, this individual will be responsible for providing proactive monitoring, identifying, investigating, and resolving technical incidents and...