Senior DataOps Engineer

5 hours ago

Ahmedabad Gujarat India, Gujarat MSBC Group Full time

Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services Lead the E-Comms data pipeline within Compass’s Application Simplification workstream: design, build, and optimize AWS-native ingestion and enrichment of high-volume communications (Bloomberg, ICE, LSEG/Refinitiv, Symphony, etc.). Ensure robust retention, security, and data integrity, and deliver reliable, analytics- and AI-ready datasets for downstream platforms.


Role Responsibilities:


  • Build AWS infrastructure using Terraform or CDK
  • Develop, maintain, test and optimize data pipelines and workflows between the source data points and target destinations.
  • Implement data management and governance frameworks to ensure compliance with regulatory and legal requirements, and security protocols.
  • Collaborate with other team members such as the Project Manager and Business Analysts to identify and address risks and challenges in real time.
  • Write unit, integration, and infrastructure tests
  • Monitor, troubleshoot and resolve issues.
  • Automate the data pipeline where possible to reduce manual risk and improve efficiency.
  • Work closely with stakeholders and subject matter experts to ensure success criterion and definition of done is met.
  • Stay updated on industry trends and emerging tech to ensure continuous improvement.


Experience / Competences


Essential:

  • 10+ years of hands-on AWS development and infrastructure experience with a financial services background.
  • Proficiency in programming Python and/or Java.
  • Proficient with Terraform or CDK (infrastructure-as-code).
  • Experience with EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, and Transfer Family.
  • Solid understanding of CI/CD pipelines, ideally with a background in software engineering, product management or data analytics.
  • Experience with market data ingestion, metadata extraction, and event-driven architectures.
  • Experience in Business Communications Technology e.g. Bloomberg, ICE, Symphony, Teams Chat, etc.
  • Familiarity with security best practices, IAM, and VPN configuration.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or related field.
  • Strong communication and collaboration skills to engage with technical and non-technical stakeholders.
  • Strong experience with Agile software delivery and proven ability to take initiative.
  • Passionate about data and being the best in class.


Desired:

  • Experience with regulatory compliance and data security in financial services.
  • Familiarity with Alation, Snowflake, or other analytics platforms
  • Knowledge of financial markets and trading platforms.
  • Certifications in DataOps, cloud platforms, or related areas.


MSBC Group has been a trusted technology partner for over 20 years, delivering the latest systems and software solutions for financial services, manufacturing, logistics, construction, and startup ecosystems. Our expertise includes Accessible AI, Custom Software Solutions, Staff Augmentation, Managed Services, and Business Process Outsourcing.


We are at the forefront of developing advanced AI-enabled services and supporting transformative projects, such as state-of-the-art trading platforms, seamless application migrations, and integrating real-time data analytics. With offices in London, California, and Ahmedabad, and operating in every time-zone, MSBC Group is your AI and automation partner.

  • Senior DataOps Engineer

    5 days ago

    Ahmedabad, Gujarat, India MSBC Group Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial ServicesLead the E-Comms data pipeline within Compass's Application Simplification workstream: design, build, and optimize AWS-native ingestion and enrichment of high-volume communications (Bloomberg, ICE, LSEG/Refinitiv, Symphony, etc.). Ensure robust retention,...

  • Senior Data Engineer

    3 days ago

    Ahmedabad, Gujarat, India ConsultMeIn Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Role: Group Lead – Data EngineeringExperience: 15 – 18 YearsCTC: Lets connect and discussLocation: Ahmedabad (Work from office, Hybrid)Are you a data visionary ready to drive transformation at scale?My client is a GCC and is looking for an exceptional Group Lead – Data Engineering to join their Global Capability Center (GCC) in India. This role is at...

  • Senior Planning Engineer

    5 hours ago

    Ahmedabad, Gujarat, India, Gujarat SGS Full time

    About the CompanyWe have urgent requirement for Senior Planning Engineer person should have good years of experience in PMC Project Building Construction.About the RoleDear Team, For Our Ongoing Project of PMC for National Maritime Heritage Complex at Lothal – Gujarat, we are in urgent need of Planning Engineer for 24 months duration having mandatory...

  • Senior Firmware Engineer

    6 hours ago

    Ahmedabad, Gujarat, India, Gujarat drivebuddyAI Full time

    Function: Engineering → Embedded SoftwareExperience Level: 8-10 Years of Relevant Industry ExperienceWe're drivebuddyAI. We aim to accelerate the evolution in the future of mobility through the transformation of the Fleet Management, Insurance Ecosystem & Autonomy. We are on a mission to enable commercial fleets with an AI-powered intelligent driver &...

  • Senior Sales Engineering Manager

    5 hours ago

    Ahmedabad, Gujarat, India, Gujarat Ajanta Bottle Pvt. Ltd. Full time

    Company Description Ajanta Bottle is India’s leading packaging supplier, offering expertise in glass, metal packaging, and closures. As a one-stop packaging solution, Ajanta Bottle integrates innovative design, manufacturing, and commercialization to serve diverse industries efficiently. With the launch of its Akikai Packaging Machines division, the...

  • VLSI - Physical Design Engineer/Senior Engineer

    5 hours ago

    Ahmedabad, Gujarat, India, Gujarat Eteros Technologies Full time

    Company: Eteros Technologies India Private LimitedEteros Technologies, Inc. is a Semiconductor Engineering services startup, head quartered in the heart of the Silicon Valley, San Jose, CA, USA. Eteros Technologies India Pvt Ltd is a wholly owned subsidiary offices in Bangalore, Noida, Hyderabad and Ahmedabad• Our world-wide customers are amongst The Who's...

  • Senior Quality Assurance Engineer

    5 hours ago

    Ahmedabad, Gujarat, India, Gujarat Tech Holding Full time

    The Role:We are seeking a passionate and detail-oriented Senior QA Engineer with automation expertise to join our growing Tech Holding family. In this role, you will lead the design, development, and execution of test strategies to ensure high-quality software delivery across web and mobile platforms. You will work closely with cross-functional teams,...

  • Senior Electrical Design Engineer

    5 hours ago

    Ahmedabad, Gujarat, India, Gujarat SES Projects pvt.Ltd Full time

    Senior Electrical Engineer (Estimation) An electrical estimator analyzes electrical projects and creates price estimates for their completion. They read blueprints, figure out what the labor and materials requirements are for a job, and then add all of that information together to make predictions that are as accurate as possible. This is a client-facing...

  • Senior Engineer

    3 days ago

    Ahmedabad, Gujarat, India Arrow Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Position:Senior Engineer (Level 1)Job Description:Along with project execution, also lead the team.Location:IN-GJ-Ahmedabad, India-Aryan Bld-2 (eInfochips)Time Type:Full timeJob Category:Engineering Services

  • Senior Engineer

    3 days ago

    Ahmedabad, Gujarat, India Arrow Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Position:Senior Engineer (Level 1)Job Description:Principal Accountabilities * Execute complete verification project in the role senior engineer with hands on experience, mentoring, client communication / interactions, in-depth technical reviews and close tracking of technical as well as management aspect * Provide guidance to team on developing UVM-based SV...