Lead Data Engineer

2 months ago

BangaloreHyderabad, Karnataka, India Talent500 Full time

Position Summary :

- Land O'Lakes is looking to add a Senior Data Engineer to our Winfield United Data & Analytics product team.

- The Senior data engineer will design & execute solutions and work with a team of engineers to ensure consistent, reliable, efficient and sustainable solutions are delivered.

- The data engineer will also contribute towards improving data management processes that result in highly accurate and trusted data assets for use in Winnfield United and across the organization.

Job Description & Responsibilities :

- Ability to obtain a clear understanding of business needs and value, mapping out the solution, and working on its implementation.

- Ability to collaborate across all levels and areas of the product & business team as well as perform hands-on implementation.

- Excellent communication, presentation, and documentation skills, including the ability to distill highly technical concepts and communicate them effectively to non-technical stakeholders.

Capable of using agile methodology and implementing Continuous Integration / Continuous Delivery (CI/CD) pipelines.

- Exposure to data vault method, model, and architecture.

- Ability to monitor the overall data landscape: meta data, processing patterns, and data quality.

- Ability to work closely with developers and data analysts to design and optimize data access, query, reporting and analysis strategies to solve complex business problems.

- Ability to proactively communicate and manage technology and projects risks.

- Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in challenging situations.

- Establish platform-wide standards.

- Perform root cause analysis when there are issues.

- Ability to proactively communicate and manage technology and projects risks.

- Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in challenging situations.

Experience Required :

- Strong experience in working with heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using various data integration technologies (ETL/ELT, data replication/CDC, message-oriented data movement, API design, etc.

- Hands on experience with programming languages such as Python, SQL to create automated processes for data gathering, cleansing, reporting, and visualization.

Experience Desired :

- 3+ years of experience leading engineering resources.

- Experience with DevOps, CI/CD pipelines and Databricks.

- Experience working with Qlik technologies (Replicate and Compose).

- Experience with any scripting languages, preferably Python.

- Experience working using agile methodologies.

- Experience in Manufacturing, Retail or Agriculture industry.

Education and Training Required :

- Bachelor's or Master's degree in Business Analytics, Computer Science, Mathematics, Statistics, or a related discipline; or an equivalent combination of demonstrated skills and experience.

Primary Skills :

- 7+ years of experience with SQL & data engineering techniques.

- 7+ years of experience building data integration solutions using tools like Informatica, Talend, Mulesoft, Qlik, etc.

- Experience in working with Cloud data warehouse like Snowflake, AWS Redshift, Azure Synapse or Google BigQuery.

Additional Skills :

- Collaborate with cross functional team to resolve data quality and operational issues.

- Demonstrating best practices for code development and optimization, unit testing, CI/CD, performance testing, capacity planning, documentation, monitoring, alerting, and incident response in order to ensure data availability, data quality, usability and required performance.

- Ability to work closely with business partners to influence decisions on technology investments.

- Ability to provide technical leadership to evangelize best practices / proven patterns and promote the use of Corporate IT standards.

- Working knowledge of data privacy regulations including GDPR and CCPA as well as how to design solutions to drive compliance.

(ref:hirist.tech)

  • Aptus Data Labs

    1 week ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Aptus Data Labs

    2 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Senior Lead

    1 week ago

    Bangalore, Karnataka, India Peepal Technology and Management Consultant Full time

    Key Responsibilities :Data Engineer Senior Lead role is to coordinate, and execute all activities related to the requirements interpretation, design, and implementation of Data Analytics applications. This individual will apply proven industry and technology experience as well as communication skills, problem-solving skills, and knowledge of best practices...

  • Senior Lead

    2 weeks ago

    Bangalore, Karnataka, India Peepal Technology and Management Consultant Full time

    Key Responsibilities :Data Engineer Senior Lead role is to coordinate, and execute all activities related to the requirements interpretation, design, and implementation of Data Analytics applications. This individual will apply proven industry and technology experience as well as communication skills, problem-solving skills, and knowledge of best practices...

  • Technical Lead

    1 week ago

    Bangalore, Karnataka, India Global KPO Full time

    We're hiring Technical Engineer Data Engineer for Bangalore location on urgent basis.Exp : 7-10 yrsSalary budget : 50-60 LPA maxRole & Responsibilities :- Thinking big and executing with great focus with a milestone-based approach rather than Big bang.- Designing and Coding by keeping scale, high availability, and cost-efficient in mind.- Mentoring and...

  • ADC Data Engineering Lead

    1 week ago

    Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...

  • ADC Data Engineering Lead

    1 month ago

    Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...

  • Technical Lead

    1 week ago

    Bangalore, Karnataka, India Kadel Labs Private Limited Full time

    Tech Lead - Data EngineerKadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergetic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180+ employees and expanding) and served 200+ Customers. At the core, KL is a people's company. We serve...

  • Technical Lead

    2 weeks ago

    Bangalore, Karnataka, India Kadel Labs Private Limited Full time

    Tech Lead - Data EngineerKadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergetic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180+ employees and expanding) and served 200+ Customers. At the core, KL is a people's company. We serve...

  • Technical Lead

    1 week ago

    Bangalore, Karnataka, India Talent Xo Full time

    Location : Bengaluru, AdugodiReview Criteria :Role : Strong Technical Lead (Data Engineering) Mandatory :- Must have 6+ YOE in experience in coding for scalable Data Engineering- Must have team leading experience.- Leading and guiding team in technical design,PR reviews and coding is must.- Must have years of recent project experience in Java or Python- Must...

  • Technical Lead

    2 weeks ago

    Bangalore, Karnataka, India Talent Xo Full time

    Location : Bengaluru, AdugodiReview Criteria :Role : Strong Technical Lead (Data Engineering) Mandatory :- Must have 6+ YOE in experience in coding for scalable Data Engineering- Must have team leading experience.- Leading and guiding team in technical design,PR reviews and coding is must.- Must have years of recent project experience in Java or Python- Must...

  • Lead Big Data Developer

    1 week ago

    Bangalore, Karnataka, India Zyoin group Full time

    Requirements :- Bachelor's Degree in Computer Science or equivalent degree is required.- 7 to 12 years of data engineering experience around database marketing technologies and data management, and technical understanding.- Strong hands-on experience in opensource components like Kafka, Flume, Spark, Hadoop, HDFS, Hive, Java/Scala, SQL, Experience with...

  • Lead Big Data Developer

    1 month ago

    Bangalore, Karnataka, India Zyoin group Full time

    Requirements :- Bachelor's Degree in Computer Science or equivalent degree is required.- 7 to 12 years of data engineering experience around database marketing technologies and data management, and technical understanding.- Strong hands-on experience in opensource components like Kafka, Flume, Spark, Hadoop, HDFS, Hive, Java/Scala, SQL, Experience with...

  • Lead Data Engineer

    1 week ago

    Bangalore, Karnataka, India Aryan Solutions Pte Ltd Full time

    We are urgently looking for Lead Data Engineer. Location : Bangalore ( Remote). Job Description : - Experience with GCP technologies (BigQuery, DataFlow, PubSub) and DBT. - Strong experience in Java is required.- Candidates without Java experience will not be considered.- Apart from Java, it is preferable but not necessary to have Python and NodeJS...

  • Lead Data Engineer

    1 month ago

    Bangalore, Karnataka, India Aryan Solutions Pte Ltd Full time

    We are urgently looking for Lead Data Engineer. Location : Bangalore ( Remote). Job Description : - Experience with GCP technologies (BigQuery, DataFlow, PubSub) and DBT. - Strong experience in Java is required.- Candidates without Java experience will not be considered.- Apart from Java, it is preferable but not necessary to have Python and NodeJS...

  • AquaSoft - Lead Data Engineer - Python

    1 week ago

    Bangalore, Karnataka, India AQUASoft Full time

    About Us :AQUASoft is a software development company that specializes in creating custom-made products and software solutions for various clients, including Fortune 500 giants and medium-sized businesses.Our team of highly skilled and experienced software engineers across two continents utilize the latest frameworks and state-of-the-art technologies to build...

  • AquaSoft - Lead Data Engineer - Python

    4 weeks ago

    Bangalore, Karnataka, India AQUASoft Full time

    About Us :AQUASoft is a software development company that specializes in creating custom-made products and software solutions for various clients, including Fortune 500 giants and medium-sized businesses.Our team of highly skilled and experienced software engineers across two continents utilize the latest frameworks and state-of-the-art technologies to build...

  • Senior Data Engineer

    1 week ago

    Bangalore/Hyderabad, Karnataka, India Sam manpower services & Career LLP Full time

    As a Senior Data Engineer, you will play a critical role in our organization by leading the design, development, and maintenance of our data pipeline infrastructure. You will work closely with cross-functional teams to ensure seamless data integration and accessibility for analytical and operational purposes.Key responsibilities:- Design, construct, and...

  • Senior Data Engineer

    2 months ago

    Bangalore/Hyderabad, Karnataka, India Sam manpower services & Career LLP Full time

    As a Senior Data Engineer, you will play a critical role in our organization by leading the design, development, and maintenance of our data pipeline infrastructure. You will work closely with cross-functional teams to ensure seamless data integration and accessibility for analytical and operational purposes.Key responsibilities:- Design, construct, and...

  • Lead Data Engineer

    1 week ago

    Bangalore, Karnataka, India Web Idea Solution LLP Full time

    Experience : 8-12 years. To be onboarded by : Immediate. Location : Bangalore. Type : Onsite/Full-TimeJob Description : Responsibilities :- 8 years' experience in developing scalable Big Data applications or solutions on distributed platforms.- Able to partner with others in solving complex problems by taking a broad perspective to identify innovative...