Lead Data Engineer

2 months ago

Bengaluru, India Spectrum Consultants India Private Limited Full time
Lead Data Engineer Summary
Experience Required:
10 - 15 Years
Job Term:
Permanent
Location:
Bangalore
Category:
Software Development
KBS India serves as a hub for innovation supporting operations for Koch companies: Georgia-Pacific, Molex, Guardian, INVISTA, Koch Ag & Energy Solutions, Koch Minerals and Trading, Koch Business Solutions, KES, etc., Specialties of Koch Business Solutions India (KBSI) include
•ERP – Services
•Quality Engineering/Testing Services
•IT Infrastructure Services
•Application Services
•Data & Analytics
•Finance, Supply Chain
•Customer Service
•Reporting
•PMO
•Transformation
•HR Solutions
•and Market Research
The Lead Data Engineer will be a part of KGSI team that designs, develops, and delivers data engineering solutions leveraging the latest data engineering technologies for Koch Industries. Koch Industries is a privately held global organization with over 120,000 employees around the world, with subsidiaries involved in manufacturing, trading, and investments. Koch Technology Center (KTC) is being developed in India to extend its IT operations, as well as act as a hub for innovation in the IT function. As KGSI rapidly scales up its operations in India, it’s employees will get opportunities to carve out a career path for themselves within the organization. This role will have the opportunity to join on the ground floor and will play a critical part in helping build out the KGSI (Koch global services india) over the next several years. Working closely with global colleagues would provide significant global exposure to the employees.
The Lead Data Engineer will report to the Data Engineering & BI Lead of the KGSI and will be responsible to develop and implement a future-state data analytics platform for both the back-end data processing and the front-end data visualization component for the Finance Data Delivery teams. This will be a hands-on role and the candidate will be responsible for designing & development of data frameworks.
A Day In The Life Could Include:
(job responsibilities)
•Be part of the data team to design and build a data engineering solutions.
•Implement batch and near real time data movement design patterns and define best practices in data engineering.
•Design and develop optimal cloud data solutions (lakes, warehouses, marts, analytics) by collaborating with diverse IT teams including business analysts, project managers, architects, and developers.
•Work closely with a team of data architects, data engineers, BI developers and data analysts to procure, blend and analyze data for quality and distribution; ensuring key elements are harmonized and modeled for effective analytics, while operating in a fluid, rapidly changing data environment
•Build data pipelines from a wide variety of sources
•Demonstrate strong conceptual, analytical, and problem-solving skills and ability to articulate ideas and technical solutions effectively to external IT partners as well as internal data team members
•Work with cross-functional teams, on-shore/off-shore, development/QA teams/Vendors in a matrixed environment for data delivery.
•Strong troubleshooting skills.
•Update and maintain key data cloud solution deliverables and diagrams
•Ensure conformance and compliance using KGSI architecture guidelines and enterprise data strategic vision
What You Will Need To Bring With You:
(experience & education required)
•Bachelor’s degree in Computer Science, Engineering, or related IT area with at least 10+ years of experience in software development.
•Primary Skill set: Data Engineering, Python (Especially strong in Object oriented Programming concepts), AWS (Glue, Lambda, EventBridge, Step functions and serverless architecture),Columnar DB(Redshift or Snowflake)
Secondary Skill set: Working with APIs, Spark, GIT/CICD, SQL,SPARK,STEP FUNCTIONS
•At least 5+ years of hands-on experience in designing, implementing, managing large-scale and ETL solutions.
•2+ Years of experience in the people management
•At least 3 years of hands-on experience in data modelling, data engineering, ETL, multi-dimensional data warehouses, cubes, with expertise in relevant languages and frameworks like SQL, Python etc.
•Hands on experience with designing and fine-tuning queries in Columnar DB(Redshift or Snowflake)
•Understanding of common DevSecOps/DataOps and CICD processes, methodologies, and technologies like GitLab, Terraform etc
•Be able to analyze large complex data sets to resolve data quality issues
What Will Put You Ahead:
(experience & education preferred)
•AWS certifications like Solution Architect (SAA/SAP) or Data Engineering Associate (DEA)
•Hands-on experience with AWS data technologies and at least one full life cycle project experience in building a data solution in AWS.
•Exposure to visualization tools, such as Tableau or PowerBI.
•Exposure with OLAP technologies and Data Virtualization (using Denodo)
•Knowledge on manufacturing domain is preferable

  • Senior Data Engineering Lead

    3 days ago

    Bengaluru, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Azure Cloud and its services, Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story of...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...

  • Digital Engineering Lead Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionWe are looking for a skilled and motivated Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India. If you are passionate about data solutions and enjoy working with cutting-edge technologies, this might be the perfect opportunity for you.Implement data storage solutions and optimize data processing using...

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Lead Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID:275332NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Lead Engineer to join our team in Bengaluru/Remote, Karnātaka (IN-KA), India (IN).Ability to...

  • Lead Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 275332 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Lead Engineer to join our team in Bengaluru/Remote, Karnātaka (IN-KA), India (IN).Ability to...

  • Digital Engineering Lead Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....

  • Digital Engineering Lead Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionNTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in bangalore, Karnātaka (IN-KA), India (IN).Java-5+ yrs,...

  • Digital Engineering Lead Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionNTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in bangalore, Karnātaka (IN-KA), India (IN).Java-5+ yrs,...

  • Digital Engineering Lead Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionNTT DATA Services is looking for outstanding individuals who are innovative, passionate, and eager to grow with us. If you're keen on being part of a dynamic, inclusive, and forward-thinking organization, this might just be the opportunity for you.We are currently in search of a Digital Engineering Lead Engineer to become part of our team in...

  • Digital Engineering Lead Engineer

    2 days ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionNTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in bangalore, Karnātaka (IN-KA), India (IN).Java-5+ yrs,...

  • Lead Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Services Full time

    Req ID:275332NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Lead Engineer to join our team in Bengaluru/Remote, Karnātaka (IN-KA), India (IN).Ability to develop solutions...

  • Digital Engineering Lead Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 274698 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India...

  • Digital Engineering Lead Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 274727 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India...

  • Digital Engineering Lead Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 274698 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India...

  • Digital Engineering Lead Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 274698 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India...

  • Digital Engineering Lead Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID:274698NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India (IN)....

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python8 to 13 years of experience in Data engineeringExtensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)Hands-on experience in SnowflakeProficient in Data Pipeline OrchestrationProficient in any one of the programing languages (python or...