Senior Data Ops Engineer

1 month ago


india Luxoft Full time

Project Description:

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics


Responsibilities:

  • Web scraping using scripts/APIs/Tools
  • Help build and maintain greenfield data platform running on Snowflake and AWS
  • Understand the existing pipelines and enhance pipelines for the new requirements.
  • Onboarding new data providers
  • Data migration projects


Mandatory Skills Description:

  • SQL
  • Python
  • Linux
  • Containerization(Docker, Kubernetes)
  • Good communication skills
  • AWS
  • Strong on Dev ops side of things(K8s, Docker, Jenkins)


Nice-to-Have Skills Description:

  • Market Data Projects/ Capital markets exp
  • Airflow


Languages:

  • English: B2 Upper-Intermediate



  • india Luxoft Full time

    Project Description:Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analyticsResponsibilities:Web scraping...


  • India Luxoft Full time

    Project Description: Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics Responsibilities: Web...


  • India Luxoft Full time

    Project Description:Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analyticsResponsibilities:Web scraping...


  • India Luxoft Full time

    Project Description: Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics Responsibilities: Web...


  • India Luxoft Full time

    Project Description:Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analyticsResponsibilities:Web scraping...


  • India Luxoft Full time

    Project Description: Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics Responsibilities: Web...

  • Senior data engineer

    3 weeks ago


    India Apidel Technologies Full time

    Job description Job Title: Senior Data Engineer – Azure & Python Shift Timing: US Shift (6 PM IST - 3:30 AM IST; flexible) Join our company as a Senior Data Engineer and drive innovation in the pharmaceutical industry! Key Responsibilities: Design & Implement: Develop and manage data workflows using Python/Pyspark and SQL. Azure Expertise: Utilize...

  • Senior data engineer

    4 hours ago


    India DeepRec.ai Full time

    Senior Data Engineer – ML Services and Data Pipelines Location: Remote Employment Type: Contract Experience: 5+ years 3 month contract + multiple extensions possible Our client is based in the USA but employs a remote workforce. You should be available for team meetings at 8am PT and have some cross over for team collaboration in PST/ET...

  • Data engineer

    2 weeks ago


    India Apidel Technologies Full time

    Data Engineer | 100% Remote | 12-Month Contract We are looking for an experienced Data Engineer to join our team on a 12-month remote contract. This role offers a great opportunity to work with Azure services, including Azure Databricks, Azure Data Factory, and Azure Dev Ops, to build secure, scalable data pipelines. What You'll Do: Develop data...

  • Senior/ data engineer

    3 weeks ago


    India Mitra AI Full time

    About Mitra Innovation ( Mitra AI is a global technology company that specializes in AI-driven solutions, cloud engineering, enterprise integration and workflow automation. Headquartered in the UK, Mitra has been serving global clients for the last 12 years in the US, UK, EU and APAC, across industries such as BFSI, telecommunications, healthcare, and...

  • Lead data engineer

    3 days ago


    India Intuitive.Cloud Full time

    About us: Intuitive. Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes. Intuitive Superpowers: - Data Ops & AI/ML - Cloud Native, App Sec Ops, Dev Sec Ops - Cloud...

  • Senior data engineer

    3 weeks ago


    India NeST Digital Full time

    Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses. Design and develop microservices to Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions. Implement...

  • Data Ops Engineer

    6 days ago


    India Live Connections Full time

    Exp : 12yrs to 16yrs We are looking for a strong IC candidate who has strong expertise in DevOps, DataOps, AWS, and Python. 12+ years in data and software engineering. Deep expertise in Data Engineering, Software Engineering, Cloud Engineering, and AI (Knowledge is Mandatory). Strong understanding of DevOps, DataOps, and product management. ...

  • Data Ops Engineer

    5 days ago


    india Live Connections Full time

    Exp : 12yrs to 16yrs We are looking for a strong IC candidate who has strong expertise in DevOps, DataOps, AWS, and Python. 12+ years in data and software engineering. Deep expertise in Data Engineering, Software Engineering, Cloud Engineering, and AI (Knowledge is Mandatory). Strong understanding of DevOps, DataOps, and product management. Experience with...

  • Data Ops Engineer

    6 days ago


    india Live Connections Full time

    Exp : 12yrs to 16yrs We are looking for a strong IC candidate who has strong expertise in DevOps, DataOps, AWS, and Python.12+ years in data and software engineering.Deep expertise in Data Engineering, Software Engineering, Cloud Engineering, and AI (Knowledge is Mandatory).Strong understanding of DevOps, DataOps, and product management.Experience with Agile...


  • India Entiovi Technologies Full time

    Senior Software Engineer We are seeking a Senior Software Engineer with a passion for technology to join our team. Key Responsibilities: Design, implement, and test new features across both front-end and back-end components of the application. Debug, track, and resolve complex technical issues, ensuring stability and optimal performance. Code...


  • India Fluidech Full time

    Job Title: Sr. Dev Sec Ops Engineer Company Profile: Fluidech is a technology consulting and managed services firm specializing in infrastructure (cloud & on-premise), automation (Dev Ops and RPA), and cybersecurity. Our name, ' Fluidech,' reflects our approach—combining 'fluid' with 'technology' to emphasize our adaptable and...


  • India Luxoft Full time

    Project description We are hiring for projects in the Middle East. The team comprises front-end and back-end developers, data analysts and data scientists, architects, analysts, and project managers. You will work with modern technologies and be an integral part of continuing to evolve our high-performing platforms. If you are serious about being a part of...


  • india DeepRec.ai Full time

    Senior Data Engineer – ML Services and Data PipelinesLocation: RemoteEmployment Type: ContractExperience: 5+ years3 month contract + multiple extensions possibleOur client is based in the USA but employs a remote workforce. You should be available for team meetings at 8am PT and have some cross over for team collaboration in PST/ET timezone. Happy to hire...


  • India DeepRec.ai Full time

    Senior Data Engineer – ML Services and Data PipelinesLocation: RemoteEmployment Type: ContractExperience: 5+ years3 month contract + multiple extensions possibleOur client is based in the USA but employs a remote workforce. You should be available for team meetings at 8am PT and have some cross over for team collaboration in PST/ET timezone. Happy to hire...