Lead Data Engineer

1 month ago


bangalore, India Spectrum Consultants India Private Limited Full time
Lead Data Engineer Summary
Experience Required:
10 - 15 Years
Job Term:
Permanent
Location:
Bangalore
Category:
Software Development
KBS India serves as a hub for innovation supporting operations for Koch companies: Georgia-Pacific, Molex, Guardian, INVISTA, Koch Ag & Energy Solutions, Koch Minerals and Trading, Koch Business Solutions, KES, etc., Specialties of Koch Business Solutions India (KBSI) include
•ERP – Services
•Quality Engineering/Testing Services
•IT Infrastructure Services
•Application Services
•Data & Analytics
•Finance, Supply Chain
•Customer Service
•Reporting
•PMO
•Transformation
•HR Solutions
•and Market Research
The Lead Data Engineer will be a part of KGSI team that designs, develops, and delivers data engineering solutions leveraging the latest data engineering technologies for Koch Industries. Koch Industries is a privately held global organization with over 120,000 employees around the world, with subsidiaries involved in manufacturing, trading, and investments. Koch Technology Center (KTC) is being developed in India to extend its IT operations, as well as act as a hub for innovation in the IT function. As KGSI rapidly scales up its operations in India, it’s employees will get opportunities to carve out a career path for themselves within the organization. This role will have the opportunity to join on the ground floor and will play a critical part in helping build out the KGSI (Koch global services india) over the next several years. Working closely with global colleagues would provide significant global exposure to the employees.
The Lead Data Engineer will report to the Data Engineering & BI Lead of the KGSI and will be responsible to develop and implement a future-state data analytics platform for both the back-end data processing and the front-end data visualization component for the Finance Data Delivery teams. This will be a hands-on role and the candidate will be responsible for designing & development of data frameworks.
A Day In The Life Could Include:
(job responsibilities)
•Be part of the data team to design and build a data engineering solutions.
•Implement batch and near real time data movement design patterns and define best practices in data engineering.
•Design and develop optimal cloud data solutions (lakes, warehouses, marts, analytics) by collaborating with diverse IT teams including business analysts, project managers, architects, and developers.
•Work closely with a team of data architects, data engineers, BI developers and data analysts to procure, blend and analyze data for quality and distribution; ensuring key elements are harmonized and modeled for effective analytics, while operating in a fluid, rapidly changing data environment
•Build data pipelines from a wide variety of sources
•Demonstrate strong conceptual, analytical, and problem-solving skills and ability to articulate ideas and technical solutions effectively to external IT partners as well as internal data team members
•Work with cross-functional teams, on-shore/off-shore, development/QA teams/Vendors in a matrixed environment for data delivery.
•Strong troubleshooting skills.
•Update and maintain key data cloud solution deliverables and diagrams
•Ensure conformance and compliance using KGSI architecture guidelines and enterprise data strategic vision
What You Will Need To Bring With You:
(experience & education required)
•Bachelor’s degree in Computer Science, Engineering, or related IT area with at least 10+ years of experience in software development.
•Primary Skill set: Data Engineering, Python (Especially strong in Object oriented Programming concepts), AWS (Glue, Lambda, EventBridge, Step functions and serverless architecture),Columnar DB(Redshift or Snowflake)
Secondary Skill set: Working with APIs, Spark, GIT/CICD, SQL,SPARK,STEP FUNCTIONS
•At least 5+ years of hands-on experience in designing, implementing, managing large-scale and ETL solutions.
•2+ Years of experience in the people management
•At least 3 years of hands-on experience in data modelling, data engineering, ETL, multi-dimensional data warehouses, cubes, with expertise in relevant languages and frameworks like SQL, Python etc.
•Hands on experience with designing and fine-tuning queries in Columnar DB(Redshift or Snowflake)
•Understanding of common DevSecOps/DataOps and CICD processes, methodologies, and technologies like GitLab, Terraform etc
•Be able to analyze large complex data sets to resolve data quality issues
What Will Put You Ahead:
(experience & education preferred)
•AWS certifications like Solution Architect (SAA/SAP) or Data Engineering Associate (DEA)
•Hands-on experience with AWS data technologies and at least one full life cycle project experience in building a data solution in AWS.
•Exposure to visualization tools, such as Tableau or PowerBI.
•Exposure with OLAP technologies and Data Virtualization (using Denodo)
•Knowledge on manufacturing domain is preferable

  • Data Engineering Lead

    1 month ago


    bangalore, India UNO Digital Bank Full time

    We are seeking a highly motivated and experienced Data Engineering Lead to join our young team. The ideal candidate will possess a deep understanding of data engineering principles, a proven track record of leading data engineering initiatives, the ability to drive the development and implementation of robust data infrastructure and an understanding of the...

  • Lead Data Engineer

    4 weeks ago


    bangalore, India Enverus Full time

    Description Enverus is a leading provider of energy analytics, trading & risk, and business automation solutions. We deliver business-critical insights to the global energy industry through a state-of-the-art SaaS platform built on industry-leading data and energy analytics. Our solutions deliver value across the entire energy value chain,...

  • Lead Data Engineer

    3 weeks ago


    bangalore, India Koch Global Services Full time

    Your Job The Lead Data Engineer will report to the Data Engineering & BI Lead of the KGSI and will be responsible to develop and implement a future-state data analytics platform for both the back-end data processing and the front-end data visualization component for the Finance Data Delivery teams. This will be a hands-on role and the candidate will be...

  • Lead Data Engineer

    17 hours ago


    bangalore, India TVS Motor Company Full time

    Role Title: Lead Data Engineer Location of job: E City Bangalore Educational Qualification: B.E in Computer science / MBA Experience: 7 - 10 Years Objective of role: This person will be responsible for overseeing all engineering related activities of the team, ensuring proper execution of duties and alignment with the business’s overall vision. The...


  • bangalore, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing! About Fractal : What makes Fractal a GREAT fit for you? When you join Fractal, you'll be part of a fast-growing team that helps our clients leverage AI together with the power of behavioral sciences to make better decisions. We're a strategic analytics partner to most admired...

  • Lead Data Engineer

    1 month ago


    Bangalore, India Huron Full time

    The Opportunity Huron is redefining what a global consulting organization can be. Advancing new ideas every day to build even stronger clients, individuals and communities. We’re helping our clients find new ways to drive growth, enhance business performance and sustain leadership in the markets they serve. And, we’re developing strategies and...

  • Lead Data Engineer

    1 month ago


    bangalore, India Huron Full time

    The Opportunity Huron is redefining what a global consulting organization can be. Advancing new ideas every day to build even stronger clients, individuals and communities. We’re helping our clients find new ways to drive growth, enhance business performance and sustain leadership in the markets they serve. And, we’re developing strategies...

  • Data Engineering Lead

    1 month ago


    bangalore, India Mercedes-Benz Full time

    Tätigkeitsbereich:IT / TelekommunikationFachabteilung:HRITIC/DE HCM ERP ExtensionsGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:sofortVeröffentlichungsdatum:..4Stellennummer:MERX3Arbeitszeit:Vollzeit Join usAufgaben Description RESPONSIBILITITES -  ...

  • Lead Data Engineer

    1 month ago


    bangalore, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data Engineer Experience: Must have 6+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    2 weeks ago


    bangalore, India Vistaprint Full time

    Lead Data EngineerWho We Are:  Vista's Engineering organization is working to make our company one of the world's most well-known and successful data-driven companies. The cross-functional team includes analysts, software and data engineers, architects, data scientists, product owners, and more - all passionate about providing Vista with solutions,...

  • Lead Data Engineer

    1 month ago


    bangalore, India dentsu Full time

    This opportunity is within dentsu's integrated global capability that delivers world-class, agile services across the dentsu network - Dentsu Creative, Dentsu Media and Merkle. In this role, you will be part of Merkle, enabling delivery of innovative data and technology solutions for Merkle's global brands. Job Title: Lead Data Engineer Job...

  • GCP Data Engineer

    1 week ago


    bangalore, India Infogain Full time

    GCP Data Engineer (Lead) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Posted on: May 08, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Mandatory skills - Java8, Python, Spark, Spring Boot, GCP/Cloud, Jenkins, Terraform. Should have at least 8+ yrs of exp (for...

  • Data Engineering Lead

    2 weeks ago


    Bangalore, India hireveda Full time

    About Company : A series-c funded Ayurvedic health brand based in India. They offer a range of natural and Ayurvedic products.Role Description : As a Data Engineering Lead at our organization, you will be at the forefront of shaping and managing our data infrastructure with a primary focus on Google Cloud Platform (GCP). You will lead a team of data...


  • Bangalore, India Indium Software Full time

    Job Description : We are seeking a highly skilled Manager/Lead Data Engineer with extensive experience in building and maintaining robust data pipelines and ETL processes. The ideal candidate will have strong expertise in PySpark, Python, SQL, and workflow orchestration tools such as Airflow. As a Manager/Lead Data Engineer, you will be responsible for...


  • bangalore, India In Time Tec Full time

    Exprience: 5+yearsJob Overview:The position requires an experienced and ambitious candidate who is passionate about technology and is self-driven. The candidate must be technically proficient in all phases of development life cycle, yet savvy enough to interface with non-technical stakeholders to achieve results and meet common project goals. The candidate...


  • bangalore, India [24]7.ai Full time

    Job Title: Lead Engineer (Data Engineering). Summary of Essential Job Functions Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow. Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform. Putting...

  • Tech Lead

    1 month ago


    bangalore, India StoneX Full time

    Overview Job Description Tech Lead – Data Reliability Engineering Reports to: Director Data Distribution Company: StoneX Group Inc. Position Purpose : As a Technical Lead in Data Reliability Engineering at StoneX you will guide our data platform and team of engineers to ensure the datasets are reliable, scalable and...


  • Bangalore, India Strategic HR Solutions Full time

    Job Description : The primary purpose of this role is to translate business requirements and functional specifications into logical program designs and to deliver modules, stable application systems, and Data or Platform solutions. This includes developing, configuring, or modifying complex integrated business and/or enterprise infrastructure or...


  • Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...


  • Bangalore, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...