Senior DataOps Engineer

2 days ago

Ahmedabad, Gujarat, India MSBC Group Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services
Lead the E-Comms data pipeline within Compass's Application Simplification workstream: design, build, and optimize AWS-native ingestion and enrichment of high-volume communications (Bloomberg, ICE, LSEG/Refinitiv, Symphony, etc.). Ensure robust retention, security, and data integrity, and deliver reliable, analytics- and AI-ready datasets for downstream platforms.

Role Responsibilities:

  • Build AWS infrastructure using Terraform or CDK
  • Develop, maintain, test and optimize data pipelines and workflows between the source data points and target destinations.
  • Implement data management and governance frameworks to ensure compliance with regulatory and legal requirements, and security protocols.
  • Collaborate with other team members such as the Project Manager and Business Analysts to identify and address risks and challenges in real time.
  • Write unit, integration, and infrastructure tests
  • Monitor, troubleshoot and resolve issues.
  • Automate the data pipeline where possible to reduce manual risk and improve efficiency.
  • Work closely with stakeholders and subject matter experts to ensure success criterion and definition of done is met.
  • Stay updated on industry trends and emerging tech to ensure continuous improvement.

Experience / Competences

Essential:

  • 10+ years of hands-on AWS development and infrastructure experience with a financial services background.
  • Proficiency in programming Python and/or Java.
  • Proficient with Terraform or CDK (infrastructure-as-code).
  • Experience with EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, and Transfer Family.
  • Solid understanding of CI/CD pipelines, ideally with a background in software engineering, product management or data analytics.
  • Experience with market data ingestion, metadata extraction, and event-driven architectures.
  • Experience in Business Communications Technology e.g. Bloomberg, ICE, Symphony, Teams Chat, etc.
  • Familiarity with security best practices, IAM, and VPN configuration.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.
  • Bachelor's degree in Computer Science, Data Science, Engineering, or related field.
  • Strong communication and collaboration skills to engage with technical and non-technical stakeholders.
  • Strong experience with Agile software delivery and proven ability to take initiative.
  • Passionate about data and being the best in class.

Desired:

  • Experience with regulatory compliance and data security in financial services.
  • Familiarity with Alation, Snowflake, or other analytics platforms
  • Knowledge of financial markets and trading platforms.
  • Certifications in DataOps, cloud platforms, or related areas.

MSBC Group has been a trusted technology partner for over 20 years, delivering the latest systems and software solutions for financial services, manufacturing, logistics, construction, and startup ecosystems. Our expertise includes Accessible AI, Custom Software Solutions, Staff Augmentation, Managed Services, and Business Process Outsourcing.

We are at the forefront of developing advanced AI-enabled services and supporting transformative projects, such as state-of-the-art trading platforms, seamless application migrations, and integrating real-time data analytics. With offices in London, California, and Ahmedabad, and operating in every time-zone, MSBC Group is your AI and automation partner.

  • Senior Engineer

    22 minutes ago

    Ahmedabad, Gujarat, India Arrow Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Position:Senior Engineer (Level 1)Job Description:Principal Accountabilities * Execute complete verification project in the role senior engineer with hands on experience, mentoring, client communication / interactions, in-depth technical reviews and close tracking of technical as well as management aspect * Provide guidance to team on developing UVM-based SV...

  • Senior Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Fuji Silvertech Concrete Private Limtited Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Senior Quality EngineerDesignationSenior EngineerJob LocationBagodara, GujaratQualificationDiploma Civil / B.E CivilComunication SkillsVery good interpersonal & communication skills in English & Hindi Excellent presentations skillsExperience05-07 YearsJob ProfileProduct quality inspection prior to dispatchHands on Experience of Pre & Post Pour Inspection of...

  • Senior Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Augmented Ally IT Solutions Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Seeking a Senior Data Engineer skilled in ETL, Palantir Foundry, Python, PySpark, and AWS. Build scalable data solutions, ensure quality, and collaborate in Agile teams. 5+ years' experience required; utility domain is a plus. Required Candidate profileSenior Data Engineer expert in cloud, ETL, and big data tools. Strong in Python, PySpark, and AWS with...

  • Senior Software Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Anhas Web Private Limited Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Job DescriptionThis is a full-time on-site role for a Senior Software Engineer having 6+ years of experience, located in Ahmedabad. The Senior Software Engineer will be responsible for designing, developing, and maintaining high-quality software solutions.QualificationsProficiency in programming languages such as Node, PHP and ReactStrong Familiarity of...

  • Senior DevOps Engineer

    5 days ago

    Ahmedabad, Gujarat, India Crest Data Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: Job Location- AhmedabadJob DescriptionWe...

  • Senior Civil Engineer

    3 days ago

    Ahmedabad, Gujarat, India f8fd1fec-d989-4aad-a942-aa1970151d4b Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionAroma Realties Limited specializes in diverse real estate development projects, including Residential Projects, Commercial Complexes, Plotted Developments, and Industrial Sheds. With expertise spanning various sectors, the company is committed to delivering high-quality infrastructure and innovative solutions. Aroma Realties Limited is...

  • Senior Civil Engineer

    2 days ago

    Ahmedabad, Gujarat, India KPI Green Hydrogen And Ammonia Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionTata Projects is a leading Engineering, Procurement, and Construction (EPC) company in India, known for delivering sustainable solutions across urban infrastructure, industrial projects, and clean energy initiatives. With expertise in sectors such as roads, bridges, rail systems, green fuels, refineries, water management, and data centers,...

  • Senior Engineer

    1 hour ago

    Ahmedabad, Gujarat, India Arrow Full time ₹ 12,00,000 - ₹ 15,00,000 per year

    Position:Senior Engineer (Level 2)_VC++Job Description:Technical Skills:Strong Programming skills on VC++ & Data Structures, expertise on OS (Memory Mgmt., Scheduling, IPC, Multi-threading/processing)Experience in windows development environment using Visual Studio.Excellent Debug Capabilities, core dump analysis using Visual Studio local...

  • Senior Application Engineer

    2 days ago

    Ahmedabad, Gujarat, India Themis Automation Pvt Ltd Full time ₹ 3,00,000 - ₹ 6,00,000 per year

    1. Task Coordination and SupportDiscuss work priorities and allocations with seniors and follow the assigned tasks.Provide technical guidance and support to junior engineers remotely or on-site as required.Take support from seniors for complex tasks or confirmations.2. Program DevelopmentReceive and review drawings from the design team for program...

  • Senior Project Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Prishma Consultants Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionPrishma Consultants Private Limited, established in 1995, provides specialized consultancy in Pre-investment, Engineering, and Project Management for Industrial, Institutional, and Infrastructure Projects. The company is renowned for its comprehensive project management services, covering all aspects from concept to commissioning under one...