Senior Data Engineer

3 weeks ago

Bengaluru Karnataka India, Karnataka Publicis Production Full time

Job Summary:

We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with Snowflake and Databricks also.

As a senior member within the data engineering space, you will play a pivotal role in designing scalable data pipelines, optimizing data workflows, and ensuring data availability and quality for production technology.

The ideal candidate brings deep technical expertise in AWS, GCP and/or Databricks alongside essential hands-on experience building pipelines in Python, analysing data requirements with SQL, and modern data engineering practices. Your ability to work across business and technology functions, drive strategic initiatives, and independently problem solve will be key to success in this role.

Qualifications:

Experience:

  • 7+ years of experience in data engineering and solution delivery, with a strong track record of technical leadership.
  • Deep understanding of data modeling, data warehousing concepts, and distributed systems.
  • Excellent problem-solving skills and ability to progress with design, build and validate output data independently.
  • Deep proficiency in Python (including PySpark), SQL, and cloud-based data engineering tools.
  • Expertise in multiple cloud platforms (AWS, GCP, or Azure) and managing cloud-based data infrastructure.
  • Strong background in database technologies (SQL Server, Redshift, PostgreSQL, Oracle).


Desirable Skills:

  • Familiarity with machine learning pipelines and MLOps practices.
  • Additional experience with Databricks and specific AWS such as Glue, S3, Lambda
  • Proficient in Git, CI/CD pipelines, and DevOps tools (e.g., Azure DevOps)
  • Hands-on experience with web scraping, REST API integrations, and streaming data pipelines.
  • Knowledge of JavaScript and front-end frameworks (e.g., React)


Key Responsibilities:

  • Architect and maintain robust data pipelines (batch and streaming) integrating internal and external data sources (APIs, structured streaming, message queues etc.).
  • Collaborate with data analysts, scientists, and software engineers to understand data needs and develop solutions.
  • Understand requirements from operations and product to ensure data and reporting needs are met
  • Implement data quality checks, data governance practices, and monitoring systems to ensure reliable and trustworthy data.
  • Optimize performance of ETL/ELT workflows and improve infrastructure scalability.

Working Conditions:

  • Full-time.
  • Limited travel may be required depending on team needs.
  • Flexibility to operate in a global organization.

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 10 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual Interview Job Description:Python, Scala/Java, Spark, SQL, Snowflake, Airflow, Databricks, AWS Big data technologiesDesign, develop,...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka ITC Infotech Full time

    Senior Data Engineer - Azure StackExperience - 3-12 yearsLocation : Bangalore, Kolkata, Gurgaon, PuneWe are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka 6thStreet.com Full time

    Job Title: Senior Data Engineer Location: Bangalore Experience: 3-5 Years Department: Data & Analytics Employment Type: Full-timeAbout the RoleWe’re looking for a Senior Data Engineer to lead the design, development, and scaling of our data infrastructure. You’ll shape best practices, mentor junior engineers, and ensure our data ecosystem empowers...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka JRD Systems Full time

    We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development. This role is critical to both the development of new data products and the modernization of existing platforms.The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures in both...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Avathon Full time

    Who We Are & Why Join UsAvathon is revolutionizing industrial AI with a powerful platform that enables businesses to harness the full potential of their operational data. Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-degree operational view that enhances decision-making and efficiency. With advanced capabilities...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Grid Dynamics Full time

    About Company Grid Dynamics (Nasdaq:GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital transformation consulting and implementation services in omnichannel customer experience, big data analytics, search, artificial intelligence, cloud...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Benchire Full time

    Hi, We are Hiring for a Senior data Engineer with 6-8 years of Experience for a IT Services company based in Bangalore .Requirements:· Min 6-8 years of professional experience· Minimum of three years of professional experience with Python· Professional experience in the field of data (e.g., data science, data engineering, data warehousing)· Experience...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Sonata Software Full time

    Mandatory* Experience building data pipelines* Highly proficient in python, Data frames* Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB* Highly proficient in SQL Query* Snowflake or experience with similar analytics database* Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code...

  • Data Senior Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Senior Engineer Req ID: 337668 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job...

  • Senior, Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...