Senior Data Engineer

2 hours ago

Bangalore Urban Karnataka India, IN Publicis Production Full time

Job Summary:

We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with Snowflake and Databricks also.

As a senior member within the data engineering space, you will play a pivotal role in designing scalable data pipelines, optimizing data workflows, and ensuring data availability and quality for production technology.

The ideal candidate brings deep technical expertise in AWS, GCP and/or Databricks alongside essential hands-on experience building pipelines in Python, analysing data requirements with SQL, and modern data engineering practices. Your ability to work across business and technology functions, drive strategic initiatives, and independently problem solve will be key to success in this role.

Qualifications:

Experience:

  • 7+ years of experience in data engineering and solution delivery, with a strong track record of technical leadership.
  • Deep understanding of data modeling, data warehousing concepts, and distributed systems.
  • Excellent problem-solving skills and ability to progress with design, build and validate output data independently.
  • Deep proficiency in Python (including PySpark), SQL, and cloud-based data engineering tools.
  • Expertise in multiple cloud platforms (AWS, GCP, or Azure) and managing cloud-based data infrastructure.
  • Strong background in database technologies (SQL Server, Redshift, PostgreSQL, Oracle).


Desirable Skills:

  • Familiarity with machine learning pipelines and MLOps practices.
  • Additional experience with Databricks and specific AWS such as Glue, S3, Lambda
  • Proficient in Git, CI/CD pipelines, and DevOps tools (e.g., Azure DevOps)
  • Hands-on experience with web scraping, REST API integrations, and streaming data pipelines.
  • Knowledge of JavaScript and front-end frameworks (e.g., React)


Key Responsibilities:

  • Architect and maintain robust data pipelines (batch and streaming) integrating internal and external data sources (APIs, structured streaming, message queues etc.).
  • Collaborate with data analysts, scientists, and software engineers to understand data needs and develop solutions.
  • Understand requirements from operations and product to ensure data and reporting needs are met
  • Implement data quality checks, data governance practices, and monitoring systems to ensure reliable and trustworthy data.
  • Optimize performance of ETL/ELT workflows and improve infrastructure scalability.

Working Conditions:

  • Full-time.
  • Limited travel may be required depending on team needs.
  • Flexibility to operate in a global organization.

  • Palantir Data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Tata Consultancy Services Full time

    Greetings from TCS !!!Role : Data EngineerExperience Range : 3-9 YearsLocation of Requirement : PAN IndiaJob Description :4+ years of experience in data engineering or data analytics roles3+ year of experience with Palantir FoundryJob OverviewWe are seeking a Senior Palantir Foundry Developer to join our data engineering and analytics team. In this role, you...

  • Senior Data Engineer

    2 hours ago

    Bangalore Urban district, India, IN AuxoAI Full time

    AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP). This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior...

  • Senior Manager-Data Science

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Tredence Inc. Full time

    The Senior Manager, Data Science will lead a team of data scientists to develop advanced analytical models and drive data-driven decision-making across the organization. This role requires a strong blend of technical expertise, strategic thinking, and leadership skills. The Senior Manager will collaborate with cross-functional teams to identify business...

  • Data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN AS Technology Corporation Full time

    We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data infrastructure solutions. This role involves working with cloud platforms, big data frameworks, and streaming technologies to enable both batch and real-time data processing for business insights and analytics.Key Responsibilities:Design, implement,...

  • Senior Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST) Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Senior Data Scientist

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Property Finder Full time

    DUBAI BASED ROLE. Relocation would be required but with highly competitive, tax free salary package.Company Profile:Property Finder is the leading digital real estate platform in the Middle East and North Africa region.A UAE-born startup, Property Finder expanded its operations to Qatar, Bahrain, Saudi Arabia, Egypt and Turkey over the yearsThe company is...

  • Data Scientist

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Straive Full time

    About the RoleStraive is looking for a talented and driven Consultant / Data Scientist / GenAI Engineer to join our Analytics & GenAI delivery team. In this role, you will work under the guidance of the Senior Project Manager / Engagement Manager to design, develop, and deploy advanced AI/ML and Generative AI solutions for global enterprise clients. You will...

  • Senior Software Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Pocket FM Full time

    Senior Software Engineer-BackendLocation: BengaluruExperience: 3–5 yearsAbout Pocket FMPocket FM, founded in 2018, is India’s leading audio storytelling platform, transforming the way millions consume stories. Offering high-quality serialized content across genres such as Romance, Drama, Thriller, Fantasy, Sci-Fi, and Mythology in eight languages, Pocket...

  • Cloud Data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Blue Cloud Softech Solutions Limited Full time

    Job Overview – Cloud Data Engineerwe strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS...

  • GCP Data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    Job Title: GCP Data EngineerLocation: BengaluruExperience: 3-8 yearsAbout the Role:Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark/Spark to transform, clean, aggregate and prepare data for analytics/ML.Orchestrate workflows using Cloud Composer (Airflow) to schedule,...