Senior Data Engineer

1 day ago

bangalore district, India Guidewire Software Full time

Responsibilities: Design and Development: Architect, design, and develop robust, scalable, and efficient data pipelines. Design and manage platform solutions to support data engineering needs to ensure seamless integration and performance. Write clean, efficient, and maintainable code. Leadership and Collaboration: Lead and mentor a team of Data engineers, providing technical guidance and fostering a collaborative environment. Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs. Drive the adoption of best practices in software development lifecycle (SDLC), including code reviews, testing, and continuous integration/continuous deployment (CI/CD). Data Management and Optimization: Ensure data quality, integrity, and security across all data pipelines. Optimize data processing workflows for performance and cost-efficiency. Develop and maintain comprehensive documentation for data pipelines and related processes. Innovation and Continuous Improvement: Stay current with emerging technologies and industry trends in big data and cloud computing. Propose and implement innovative solutions to improve data processing and analytics capabilities. Continuously evaluate and improve existing data infrastructure and processes. Qualifications: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 8+ years of experience in software engineering with a focus on data engineering and building data platform Strong programming experience using Python or Java. Proven experience with Big data technologies like Apache Spark, Amazon EMR, Apache Iceberg, Amazon Redshift, etc or Similar technologies Proven experience in RDBMS(Postgres, MySql, etc) and NoSQL(MongoDB, DynamoDB, etc) database Proficient in AWS cloud services (e.g., Lambda, S3, Athena, Glue) or comparable cloud technologies. Demonstrated leadership experience, with a track record of leading and mentoring engineering teams. In-depth understanding of SDLC best practices, including Agile methodologies, code reviews, and CI/CD. Experience working in Event driven and Serverless Architecture Experience with platform solutions and containerization technologies (e.g., Docker, Kubernetes). Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment. Strong communication skills, both written and verbal.

  • Senior Data Engineer

    1 week ago

    bangalore district, India 6thStreet.com Full time

    Job Title: Senior Data Engineer Location: Bangalore Experience: 3-5 Years Department: Data & Analytics Employment Type: Full-time About the Role We’re looking for a Senior Data Engineer to lead the design, development, and scaling of our data infrastructure. You’ll shape best practices, mentor junior engineers, and ensure our data ecosystem empowers...

  • Senior/Lead Data Engineer

    2 weeks ago

    bangalore, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...

  • Senior Data Engineer

    2 weeks ago

    bangalore district, India USEReady Full time

    Job Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and...

  • Senior Data Engineer

    1 week ago

    bangalore district, India Avathon Full time

    Who We Are & Why Join Us Avathon is revolutionizing industrial AI with a powerful platform that enables businesses to harness the full potential of their operational data. Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-degree operational view that enhances decision-making and efficiency. With advanced capabilities...

  • Senior Data Engineer

    2 weeks ago

    bangalore district, India Syncarp Full time

    Looking for Lead Engineer / Technical Lead for a Global IT Service Provider based out of Chennai/Bangalore/Hyderabad/Pune Locations. Job Description: Lead Engineer: Exp: 5-8 Years Design, develop, and maintain simulation services and tools for ML feature, model, and rule evaluation. Build and optimize data pipelines for point-in-time historical data...

  • Senior GCP Data Engineer

    1 day ago

    bangalore district, India Ascendion Full time

    Job Title: Senior GCP Data Engineer (7 - 12 Years) Job Type: Full-Time Work Mode: Hybrid Locations: Bengaluru, Hyderabad, Chennai, Pune Job Summary: We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficiency in Python to join our data engineering team. The ideal candidate should have hands-on experience working...

  • Data Engineer

    2 weeks ago

    bangalore, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%)  Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Senior Data Engineer

    2 weeks ago

    bangalore district, India Josys Full time

    Location: Bengaluru, Karnataka, India About The Role We're looking for an experienced Senior Data Engineer (6-8 years) to join our data team. You'll be key in building and maintaining our data systems on AWS. You'll use your strong skills in big data tools and cloud technology to help our analytics team get valuable insights from our data. You'll be in...

  • Senior Data Engineer

    1 week ago

    bangalore district, India Quantiphi Full time

    Role: Senior Data Engineer Experience Level: 4 to 7 Years Work location: Mumbai/Bangalore (Hybrid) Required Skills: ● Bachelor’s degree in Computer Science or similar field or equivalent work experience. ● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects. ● Expert with data warehousing concepts, strategies,...

  • Senior Principal Data Engineer

    2 weeks ago

    bangalore district, India MakeMyTrip Full time

    Position: Senior Principal Data Engineer Experience: Must have 10+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower the...