Senior Data Engineer

3 weeks ago

Anywhere in IndiaMultiple Locations BLossomJob Full time

Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts

- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation
for IOT in Spark streaming. Kafka expertise.

Any experience with MFG BI, DWH and Datalake implementation would be a bonus.

Location : WFH from India

Domain : Semicon

- 1x new headcount in 7-10 yrs band (Europe Time Zone)

- 1x headcount in 10+ yrs band (Malaysia Time Zone)

Mode : Permanent or yearly renewable contract under us

Notice : immediate - 2 weeks

Interview rounds : 3 or 4

KEY RESPONSIBILITIES :

- Understand the factories , manufacturing process , data availability and avenues for improvement

- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.

- Define what data is required to create a solution and work with connectivity engineers , users to collect the data

- Create and maintain optimal data pipeline architecture.

- Assemble large, complex data sets that meet functional / non-functional business requirements.

- Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery for greater scalability

- Work on data preparation, data deep dive , help engineering, process and quality to understand the process/ machine behavior more closely using available data

- Deploy and monitor the solution

- Work with data and analytics experts to strive for greater functionality in our data systems.

- Work together with Data Architects and data modeling teams.

SKILLS /COMPETENCIES :

- Good knowledge of the business vertical with prior experience in solving different use cases in the manufacturing or similar industry

- Ability to bring cross industry learning to benefit the use cases aimed at improving manufacturing process

Problem Scoping/definition Skills :

- Experience in problem scoping, solving, quantification

- Strong analytic skills related to working with unstructured datasets.

- Build processes supporting data transformation, data structures, metadata, dependency and workload management.

- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores

- Ability to foresee and identify all right data required to solve the problem

Data Wrangling Skills :

- Strong skill in data mining, data wrangling techniques for creating the required analytical dataset

- Experience building and optimizing 'big data' data pipelines, architectures and data sets

- Adaptive mindset to improvise on the data challenges and employ techniques to drive desired outcomes

Programming Skills :

- Experience with big data tools : Spark,Delta,CDC,NiFi, Kafka, etc

- Experience with relational SQL ,NoSQL databases and query languages, including oracle , Hive, sparkQL.

- Experience with object-oriented languages : Scala, Java, C++ etc.

Visualization Skills :

- Know how of any visualization tools such as PowerBI, Tableau

- Good storytelling skills to present the data in simple and meaningful manner

Data Engineering Skills :

- Strong skill in data analysis techniques to generate finding and insights by means of exploratory data analysis

- Good understanding of how to transform and connect the data of various types and form

- Great numerical and analytical skills

- Identify opportunities for data acquisition

- Explore ways to enhance data quality and reliability

- Build algorithms and prototypes

- Reformulating existing frameworks to optimize their functioning.

- Good understanding of optimization techniques to make the system performant for requirements.

(ref:hirist.tech)

  • Senior Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations MindBrain Full time

    Company Description. MindBrain seamlessly integrates innovation, education, and strategic workforce solutions. As a dynamic software company, we shape the future of technology. With a focus on comprehensive IT and non-IT training, we nurture talent, empowering individuals to lead in a rapidly evolving landscape. Through strategic resource augmentation, we...

  • Senior Data Engineer

    1 week ago

    Anywhere in India/Multiple Locations, IN MindBrain Full time

    Company Description. MindBrain seamlessly integrates innovation, education, and strategic workforce solutions. As a dynamic software company, we shape the future of technology. With a focus on comprehensive IT and non-IT training, we nurture talent, empowering individuals to lead in a rapidly evolving landscape. Through strategic resource augmentation, we...

  • Senior Data Engineer

    1 week ago

    Anywhere in India/Multiple Locations TekNinjas Full time

    Position: Senior Data Engineer An independent contributor expected to be an expert in the technology area. Excellent Communication & Customer Interaction Skills with positive attitude.Job Description:Must Have: 57 Years of data engineering experience in building ETL and ETL data pipelines for various types of data source extraction, incremental loading, and...

  • Senior Data Engineer

    1 week ago

    Anywhere in India/Multiple Locations DataAlpha Full time

    The Opportunity :As a Senior Data Engineer, you'll be the mastermind behind building and maintaining a highly scalable data pipeline framework. This framework will be the cornerstone for our clients to construct data pipelines effortlessly from a multitude of input sources. You'll collaborate extensively across product, business, design, and engineering...

  • Senior Data Engineer

    1 week ago

    Anywhere in India/Multiple Locations Aventior Digital Private Limited Full time

    Designation : Senior Data EngineerPreferred Experience : 7+ years of :Collaborate with the Data Migrations Technical Project Manager to plan, execute, and track data migrations projects.Work to establish yourself as the Data Migrations Team "go-to" technical lead. Help coordinate and facilitate work across the Data Migrations Team - enabling and ensuring...

  • Senior/Staff Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations Grorapid labs Full time

    Senior / Staff Engineer Data Engineering Experience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...

  • Senior/Staff Engineer

    2 months ago

    Anywhere in India,Multiple Locations Grorapid labs Full time

    Senior / Staff Engineer Data Engineering Experience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...

  • Senior/Staff Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Grorapid labs Full time

    Senior / Staff Engineer Data EngineeringExperience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...

  • Senior/Staff Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Grorapid labs Full time

    Senior / Staff Engineer Data EngineeringExperience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...

  • Senior Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • Senior Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • Senior Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • Senior Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • Senior Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN TekNinjas Full time

    Position : Senior Data Engineer- An independent contributor expected to be an expert in the technology area.- Excellent Communication & Customer Interaction Skills with positive attitude.Job Description :Must Have :- 5-7 Years of data engineering experience in building ETL and ETL data pipelines for various types of data source extraction, incremental...

  • Senior Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations TekNinjas Full time

    Position : Senior Data Engineer- An independent contributor expected to be an expert in the technology area.- Excellent Communication & Customer Interaction Skills with positive attitude.Job Description :Must Have :- 5-7 Years of data engineering experience in building ETL and ETL data pipelines for various types of data source extraction, incremental...

  • Senior Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN TekNinjas Full time

    Position : Senior Data Engineer- An independent contributor expected to be an expert in the technology area.- Excellent Communication & Customer Interaction Skills with positive attitude.Job Description :Must Have :- 5-7 Years of data engineering experience in building ETL and ETL data pipelines for various types of data source extraction, incremental...

  • Senior Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations TekNinjas Full time

    Position : Senior Data Engineer- An independent contributor expected to be an expert in the technology area.- Excellent Communication & Customer Interaction Skills with positive attitude.Job Description :Must Have :- 5-7 Years of data engineering experience in building ETL and ETL data pipelines for various types of data source extraction, incremental...

  • Senior Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Aventior Digital Private Limited Full time

    Designation : Senior Data EngineerPreferred Experience : 7+ years of :- Collaborate with the Data Migrations Technical Project Manager to plan, execute, and track data migrations projects.- Work to establish yourself as the Data Migrations Team "go-to" technical lead. Help coordinate and facilitate work across the Data Migrations Team - enabling and ensuring...

  • Senior Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Aventior Digital Private Limited Full time

    Designation : Senior Data EngineerPreferred Experience : 7+ years of :- Collaborate with the Data Migrations Technical Project Manager to plan, execute, and track data migrations projects.- Work to establish yourself as the Data Migrations Team "go-to" technical lead. Help coordinate and facilitate work across the Data Migrations Team - enabling and ensuring...

  • Senior Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations Aventior Digital Private Limited Full time

    Designation : Senior Data Engineer Preferred Experience : 7+ years of : - Collaborate with the Data Migrations Technical Project Manager to plan, execute, and track data migrations projects. - Work to establish yourself as the Data Migrations Team "go-to" technical lead. Help coordinate and facilitate work across the Data Migrations Team - enabling and...