Senior DataOps Engineer

5 days ago

Bengaluru, India MSBC Group Full time

Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services Lead the E-Comms data pipeline within Compass’s Application Simplification workstream: design, build, and optimize AWS-native ingestion and enrichment of high-volume communications (Bloomberg, ICE, LSEG/Refinitiv, Symphony, etc.). Ensure robust retention, security, and data integrity, and deliver reliable, analytics- and AI-ready datasets for downstream platforms.Role Responsibilities:Build AWS infrastructure using Terraform or CDKDevelop, maintain, test and optimize data pipelines and workflows between the source data points and target destinations.Implement data management and governance frameworks to ensure compliance with regulatory and legal requirements, and security protocols.Collaborate with other team members such as the Project Manager and Business Analysts to identify and address risks and challenges in real time.Write unit, integration, and infrastructure testsMonitor, troubleshoot and resolve issues.Automate the data pipeline where possible to reduce manual risk and improve efficiency.Work closely with stakeholders and subject matter experts to ensure success criterion and definition of done is met.Stay updated on industry trends and emerging tech to ensure continuous improvement.Experience / CompetencesEssential:10+ years of hands-on AWS development and infrastructure experience with a financial services background.Proficiency in programming Python and/or Java.Proficient with Terraform or CDK (infrastructure-as-code).Experience with EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, and Transfer Family.Solid understanding of CI/CD pipelines, ideally with a background in software engineering, product management or data analytics.Experience with market data ingestion, metadata extraction, and event-driven architectures.Experience in Business Communications Technology e.g. Bloomberg, ICE, Symphony, Teams Chat, etc.Familiarity with security best practices, IAM, and VPN configuration.Excellent problem-solving skills and ability to work in a fast-paced environment.Bachelor’s degree in Computer Science, Data Science, Engineering, or related field.Strong communication and collaboration skills to engage with technical and non-technical stakeholders.Strong experience with Agile software delivery and proven ability to take initiative.Passionate about data and being the best in class.Desired:Experience with regulatory compliance and data security in financial services.Familiarity with Alation, Snowflake, or other analytics platformsKnowledge of financial markets and trading platforms.Certifications in DataOps, cloud platforms, or related areas.MSBC Group has been a trusted technology partner for over 20 years, delivering the latest systems and software solutions for financial services, manufacturing, logistics, construction, and startup ecosystems. Our expertise includes Accessible AI, Custom Software Solutions, Staff Augmentation, Managed Services, and Business Process Outsourcing.We are at the forefront of developing advanced AI-enabled services and supporting transformative projects, such as state-of-the-art trading platforms, seamless application migrations, and integrating real-time data analytics. With offices in London, California, and Ahmedabad, and operating in every time-zone, MSBC Group is your AI and automation partner.

  • Senior DataOps Engineer

    1 week ago

    Bengaluru, Karnataka, India Terralogic Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Overview:Who are we looking for?The ideal candidate has an emphasis on data infrastructure to help operationalize and maintain machine learning models and pipelines. The candidate will love automating via Infrastructure as code (IaC), be comfortable with AWS cloud services, and can design and implement end-to-end data and analytic infrastructure solutions.As...

  • Senior Data/DataOps Engineer

    2 weeks ago

    Bengaluru, India Antal International Full time

    Position Summary: As the (Senior) Data/DataOps Enginee r, you will be responsible for designing, developing, and maintaining scalable data pipelines, managing data integration, and ensuring robust data quality and governance to enhance and support our systematic trading activities. This role is critical to ensuring the efficiency, reliability, and...

  • DataOps Engineer

    3 weeks ago

    Bengaluru, India Landmark Group Full time

    Job DescriptionResponsible for the governance ensuring data availability, accuracy, and performance across environments as an expert Azure Data Ops with 6-8 years of experience. Orchestrate, monitor, and automate data pipelines across Azure Data Factory, Databricks, and Synapse. Build scalable CI/CD workflows using Azure DevOps for data deployments and...

  • DataOps Engineer

    1 week ago

    Bengaluru, India Landmark Group Full time

    Job Description- Responsible for the governance ensuring data availability, accuracy, and performance across environments as an expert Azure Data Ops with 6-8 years of experience.- Orchestrate, monitor, and automate data pipelines across Azure Data Factory, Databricks, and Synapse.- Build scalable CI/CD workflows using Azure DevOps for data deployments and...

  • DataOps Engineer

    1 week ago

    Bengaluru, India Landmark Group Full time

    Job Description - Responsible for the governance ensuring data availability, accuracy, and performance across environments as an expert Azure Data Ops with 6-8 years of experience. - Orchestrate, monitor, and automate data pipelines across Azure Data Factory, Databricks, and Synapse. - Build scalable CI/CD workflows using Azure DevOps for data deployments...

  • Lead DataOps Engineer

    2 weeks ago

    Bengaluru, Karnataka, India FirstHive | CDP+AI Data Platform Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About us:FirstHive is a USA headquartered company with operations and customers across the US, India, and ASEAN and is a premier global Customer Data Platform - a tool for consumer marketing enterprises to consolidate all their opt-in first-party consumer data.We are building an AI led marketing tech product that is changing the fabric of marketing globally...

  • FirstHive - Lead DataOps Engineer - ETL/ELT Pipelines

    2 weeks ago

    Bengaluru, India FirstHive Full time

    Job Designation : Senior Data Ops Engineer Team LeadJob Location : BengaluruKey Responsibilities :Leadership & Team Management :- Lead and mentor a team of DataOps engineers in designing and maintaining robust data pipelines.- Plan, assign, and review team tasks to ensure timely and quality delivery.- Collaborate with data engineers, data scientists, and...

  • Cognite - Senior Software Engineer - DataOps

    2 weeks ago

    Bengaluru, India Cognite Full time

    What You'll Own And Build :Build Systems That Power Industrial DataOps :- Design and implement high-throughput data ingestion and processing services that integrate industrial data sources into a unified, contextualized data platform.- Own key components and services end-to-end, from technical design through deployment, monitoring, and production...

  • FirstHive - Lead DataOps Engineer - ETL/ELT Pipelines

    2 weeks ago

    Bengaluru, Karnataka, India FirstHive | CDP+AI Data Platform Full time ₹ 2,00,00,000 - ₹ 4,00,00,000 per year

    Job Designation :Senior Data Ops Engineer Team LeadJob Location :BengaluruKey ResponsibilitiesLeadership & Team Management :Lead and mentor a team of DataOps engineers in designing and maintaining robust data pipelines.Plan, assign, and review team tasks to ensure timely and quality delivery.Collaborate with data engineers, data scientists, and business...

  • DevSecOps / DataOps Engineer

    1 week ago

    Bengaluru, Chennai, Hyderabad, India HCLTech Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per year

    Greetings from HCLCurrently Hiring for DevSecOps / DataOps EngineerMandatory SkillsTool Knowledge: AWS Cloud like Glue,Redshift,IAM,s3,SQS,SNS etc., Databricks, dbt, Airflow, Matillion (Preferrable)DevOps: GitHub Action, Terraform, AWS CDK (Preferrable)Language: Python, Pyspark, SQLJD7-15 years of experience in end-to-end application Development, Deployment...