Senior Data Engineer

1 week ago

Bengaluru Karnataka India, Karnataka Guidewire Software Full time

Responsibilities:

  • Design and Development:
  • Architect, design, and develop robust, scalable, and efficient data pipelines.
  • Design and manage platform solutions to support data engineering needs to ensure seamless integration and performance.
  • Write clean, efficient, and maintainable code.
  • Leadership and Collaboration:
  • Lead and mentor a team of Data engineers, providing technical guidance and fostering a collaborative environment.
  • Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
  • Drive the adoption of best practices in software development lifecycle (SDLC), including code reviews, testing, and continuous integration/continuous deployment (CI/CD).
  • Data Management and Optimization:
  • Ensure data quality, integrity, and security across all data pipelines.
  • Optimize data processing workflows for performance and cost-efficiency.
  • Develop and maintain comprehensive documentation for data pipelines and related processes.
  • Innovation and Continuous Improvement:
  • Stay current with emerging technologies and industry trends in big data and cloud computing.
  • Propose and implement innovative solutions to improve data processing and analytics capabilities.
  • Continuously evaluate and improve existing data infrastructure and processes.

Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 8+ years of experience in software engineering with a focus on data engineering and building data platform
  • Strong programming experience using Python or Java.
  • Proven experience with Big data technologies like Apache Spark, Amazon EMR, Apache Iceberg, Amazon Redshift, etc or Similar technologies
  • Proven experience in RDBMS(Postgres, MySql, etc) and NoSQL(MongoDB, DynamoDB, etc) database
  • Proficient in AWS cloud services (e.g., Lambda, S3, Athena, Glue) or comparable cloud technologies.
  • Demonstrated leadership experience, with a track record of leading and mentoring engineering teams.
  • In-depth understanding of SDLC best practices, including Agile methodologies, code reviews, and CI/CD.
  • Experience working in Event driven and Serverless Architecture
  • Experience with platform solutions and containerization technologies (e.g., Docker, Kubernetes).
  • Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment.
  • Strong communication skills, both written and verbal.

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 10 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual Interview Job Description:Python, Scala/Java, Spark, SQL, Snowflake, Airflow, Databricks, AWS Big data technologiesDesign, develop,...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka ITC Infotech Full time

    Senior Data Engineer - Azure StackExperience - 3-12 yearsLocation : Bangalore, Kolkata, Gurgaon, PuneWe are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Publicis Production Full time

    Job Summary:We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka 6thStreet.com Full time

    Job Title: Senior Data Engineer Location: Bangalore Experience: 3-5 Years Department: Data & Analytics Employment Type: Full-timeAbout the RoleWe’re looking for a Senior Data Engineer to lead the design, development, and scaling of our data infrastructure. You’ll shape best practices, mentor junior engineers, and ensure our data ecosystem empowers...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka JRD Systems Full time

    We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development. This role is critical to both the development of new data products and the modernization of existing platforms.The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures in both...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Avathon Full time

    Who We Are & Why Join UsAvathon is revolutionizing industrial AI with a powerful platform that enables businesses to harness the full potential of their operational data. Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-degree operational view that enhances decision-making and efficiency. With advanced capabilities...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Grid Dynamics Full time

    About Company Grid Dynamics (Nasdaq:GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital transformation consulting and implementation services in omnichannel customer experience, big data analytics, search, artificial intelligence, cloud...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Benchire Full time

    Hi, We are Hiring for a Senior data Engineer with 6-8 years of Experience for a IT Services company based in Bangalore .Requirements:· Min 6-8 years of professional experience· Minimum of three years of professional experience with Python· Professional experience in the field of data (e.g., data science, data engineering, data warehousing)· Experience...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India, Karnataka Sonata Software Full time

    Mandatory* Experience building data pipelines* Highly proficient in python, Data frames* Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB* Highly proficient in SQL Query* Snowflake or experience with similar analytics database* Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code...

  • Data Senior Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Senior Engineer Req ID: 337668 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job...