Senior Data Engineer

3 hours ago

Bangalore Urban district India, IN AuxoAI Full time

AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP). This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior engineers.

You’ll work closely with cross-functional teams to build production-grade pipelines using tools like BigQuery, Dataflow, Pub/Sub, Cloud Composer, and Dataform, enabling high-quality data delivery and analytics at scale.


Responsibilities:

  • Build and optimize batch and streaming data pipelines using Apache Beam (Dataflow)
  • Design and maintain BigQuery datasets using best practices in partitioning, clustering, and materialized views
  • Develop and manage Airflow DAGs in Cloud Composer for workflow orchestration
  • Implement SQL-based transformations using Dataform (or dbt)
  • Leverage Pub/Sub for event-driven ingestion and Cloud Storage for raw/lake layer data architecture
  • Drive engineering best practices across CI/CD, testing, monitoring, and pipeline observability
  • Partner with solution architects and product teams to translate data requirements into technical designs
  • Mentor junior data engineers and support knowledge-sharing across the team
  • Contribute to documentation, code reviews, sprint planning, and agile ceremonies


Requirements:

  • 5+ years of hands-on experience in data engineering, with at least 2 years on GCP
  • Proven expertise in BigQuery, Dataflow (Apache Beam), Cloud Composer (Airflow)
  • Strong programming skills in Python and/or Java
  • Experience with SQL optimization, data modeling, and pipeline orchestration
  • Familiarity with Git, CI/CD pipelines, and data quality monitoring frameworks
  • Exposure to Dataform, dbt, or similar tools for ELT workflows
  • Solid understanding of data architecture, schema design, and performance tuning
  • Excellent problem-solving and collaboration skills


Bonus Skills:

  • GCP Professional Data Engineer certification
  • Experience with Vertex AI, Cloud Functions, Dataproc, or real-time streaming architectures
  • Familiarity with data governance tools (e.g., Atlan, Collibra, Dataplex)
  • Exposure to Docker/Kubernetes, API integration, and infrastructure-as-code (Terraform)


  • Senior Data Engineer

    3 hours ago

    Bangalore Urban, Karnataka, India, IN Publicis Production Full time

    Job Summary:We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with...

  • Palantir Data Engineer

    3 hours ago

    Bangalore Urban, Karnataka, India, IN Tata Consultancy Services Full time

    Greetings from TCS !!!Role : Data EngineerExperience Range : 3-9 YearsLocation of Requirement : PAN IndiaJob Description :4+ years of experience in data engineering or data analytics roles3+ year of experience with Palantir FoundryJob OverviewWe are seeking a Senior Palantir Foundry Developer to join our data engineering and analytics team. In this role, you...

  • Senior Data Engineer

    3 hours ago

    Gurugram, Haryana, India, IN Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST) Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Senior Data Engineer

    3 hours ago

    , India, IN Donyati Full time

    Senior Data Engineer Job Title: Senior Data EngineerLocation: Remote/ Willing to TravelJob Type: Full-timeExperience Level: 8+ yearsAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS. You will play a key role in transitioning from legacy systems to a scalable, cloud-native...

  • Senior Manager-Data Science

    3 hours ago

    Bangalore Urban, Karnataka, India, IN Tredence Inc. Full time

    The Senior Manager, Data Science will lead a team of data scientists to develop advanced analytical models and drive data-driven decision-making across the organization. This role requires a strong blend of technical expertise, strategic thinking, and leadership skills. The Senior Manager will collaborate with cross-functional teams to identify business...

  • AI & Data Analytics Engineer

    3 hours ago

    Bangalore Urban district, India, IN Amphenol Full time

    OverviewWe are seeking a highly motivated AI & Data Analytics Engineer to join our Internal Audit department. This role will play a critical part in modernizing and streamlining our testing processes through automation, artificial intelligence (AI), advanced analytics, and innovative coding solutions. The Analyst will collaborate with auditors and...

  • Data Engineer

    3 hours ago

    Bangalore Urban, Karnataka, India, IN AS Technology Corporation Full time

    We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data infrastructure solutions. This role involves working with cloud platforms, big data frameworks, and streaming technologies to enable both batch and real-time data processing for business insights and analytics.Key Responsibilities:Design, implement,...

  • Senior Data Engineer

    3 hours ago

    india, IN Intellify Solutions Full time

    Title: Senior Data EngineerLocation: Remote, IndiaTotal years of experience: 10+ years Requirements:● Required: Bachelor’s degree or relevant experience● Required: Prior experience as a software engineer or data engineer in afast-paced, technical, problem-solving environment● Required: Cloud Data Warehouse experience - Snowflake● Required: Expert...

  • Senior Data Engineer

    3 hours ago

    Gurugram, Haryana, India, IN dunnhumby Full time

    Retail Media is transforming how advertisers connect with consumers through personalized and targeted campaigns across retailers' digital and physical touchpoints. Retail Media Measurement plays a pivotal role in ensuring the effectiveness of these campaigns, driving value for advertisers, retailers, and consumers alike.This role focuses on designing,...

  • Senior Data Scientist

    3 hours ago

    Bangalore Urban, Karnataka, India, IN Property Finder Full time

    DUBAI BASED ROLE. Relocation would be required but with highly competitive, tax free salary package.Company Profile:Property Finder is the leading digital real estate platform in the Middle East and North Africa region.A UAE-born startup, Property Finder expanded its operations to Qatar, Bahrain, Saudi Arabia, Egypt and Turkey over the yearsThe company is...