Senior Data Engineer

2 days ago

Bengaluru, India AuxoAI Engineering Pvt. Ltd. Full time

Job Description AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP) . This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior engineers. You’ll work closely with cross-functional teams to build production-grade pipelines using tools like BigQuery, Dataflow, Pub/Sub, Cloud Composer , and Dataform , enabling high-quality data delivery and analytics at scale. Responsibilities: Build and optimize batch and streaming data pipelines using Apache Beam (Dataflow) Design and maintain BigQuery datasets using best practices in partitioning, clustering, and materialized views Develop and manage Airflow DAGs in Cloud Composer for workflow orchestration Implement SQL-based transformations using Dataform (or dbt) Leverage Pub/Sub for event-driven ingestion and Cloud Storage for raw/lake layer data architecture Drive engineering best practices across CI/CD, testing, monitoring, and pipeline observability Partner with solution architects and product teams to translate data requirements into technical designs Mentor junior data engineers and support knowledge-sharing across the team Contribute to documentation, code reviews, sprint planning, and agile ceremonies Requirements 5+ years of hands-on experience in data engineering , with at least 2 years on GCP Proven expertise in BigQuery , Dataflow (Apache Beam) , Cloud Composer (Airflow) Strong programming skills in Python and/or Java Experience with SQL optimization , data modeling , and pipeline orchestration Familiarity with Git , CI/CD pipelines , and data quality monitoring frameworks Exposure to Dataform , dbt , or similar tools for ELT workflows Solid understanding of data architecture , schema design , and performance tuning Excellent problem-solving and collaboration skills Bonus Skills: GCP Professional Data Engineer certification Experience with Vertex AI , Cloud Functions , Dataproc , or real-time streaming architectures Familiarity with data governance tools (e.g., Atlan, Collibra, Dataplex) Exposure to Docker/Kubernetes , API integration , and infrastructure-as-code (Terraform) Requirements Bachelor’s degree in Computer Science, Engineering, or related field; or equivalent work experience. Proven experience as a DevOps Engineer or similar role with hands-on expertise in AWS and Azure cloud environments. Strong proficiency in Azure DevOps, Git, GitHub, Jenkins, and CI/CD pipeline automation. Experience deploying and managing Kubernetes clusters (EKS, AKS) and container orchestration platforms. Deep understanding of cloud-native architectures, microservices, and serverless computing. Familiarity with Azure Synapse, ADF, ADLS, and AWS data services (EMR, Redshift, Glue) for data integration and analytics. Solid grasp of infrastructure as code (IaC) tools like Terraform, CloudFormation, or ARM templates. Experience with monitoring tools (e.g., Prometheus, Grafana) and logging solutions for cloud-based applications. Excellent troubleshooting skills and ability to resolve complex technical issues in production environments.

  • Senior Data Engineer

    1 week ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at NTT...

  • Senior Data Engineer cum Data Scientist

    2 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...

  • Senior Data Scientist

    4 days ago

    Bengaluru, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    1 week ago

    Bengaluru, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    1 week ago

    Bengaluru, India IC Data Full time

    Senior Data Scientist (Remote Sensing) About the job Sagri Inc. is a pioneering social impact startup founded in 2018 with the vision of "realizing the coexistence of humanity and the earth." We utilize satellite data and AI technology to address global food crises and climate change challenges. Our core products - Actaba, Detaba, and Sagri - offer...

  • Senior Data Scientist

    3 days ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    1 day ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior AI Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,20,000 - US$ 1,80,000 per year

    Req ID: 345129NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior AI Engineer - Senior Specialist to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior AI...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Senior Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India Anicca Data Science Solutions Full time ₹ 1,20,000 - ₹ 3,60,000 per year

    Job Description – Senior Data ScientistLocation:Bengaluru (Full-time, Onsite)About Anicca DataAnicca Data is a leading team of Data Science and Technology experts specializing in:Personalization, Recommendation Engines, and Product Search RankingLoyalty Programs and Customer AnalyticsSupply Chain Optimization (Demand Forecasting, Inventory, Replenishment &...