Senior Data Engineer

3 weeks ago


OverseasInternational, India Freelancer HR Full time

Job Description Responsibilities :


- Understand the factories , manufacturing process , data availability and avenues for improvement

- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.

- Define what data is required to create a solution and work with connectivity engineers , users to collect the data

- Create and maintain optimal data pipeline architecture.

- Assemble large, complex data sets that meet functional / non-functional business requirements.

- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery for greater scalability

- Work on data preparation, data deep dive , help engineering, process and quality to understand the process/ machine behavior more closely using available data

- Deploy and monitor the solution

- Work with data and analytics experts to strive for greater functionality in our data systems.

- Work together with Data Architects and data modeling /Competencies :


- Good knowledge of the business vertical with prior experience in solving different use cases in the manufacturing or similar industry


- Ability to bring cross industry learning to benefit the use cases aimed at improving manufacturing process

Problem Scoping/definition Skills :

- Experience in problem scoping, solving, quantification

- Strong analytic skills related to working with unstructured datasets.

- Build processes supporting data transformation, data structures, metadata, dependency and workload management.

- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores

- Ability to foresee and identify all right data required to solve the problem

Data Wrangling Skills :


- Strong skill in data mining, data wrangling techniques for creating the required analytical dataset


- Experience building and optimizing 'big data' data pipelines, architectures and data sets

- Adaptive mindset to improvise on the data challenges and employ techniques to drive desired outcomes

Programming Skills :

- Experience with big data tools: Spark, Delta, CDC, NiFi, Kafka, etc

- Experience with relational SQL ,NoSQL databases and query languages, including oracle , Hive, sparkQL.

- Experience with object-oriented languages: Scala, Java, C++ Skills :


- Know how of any visualization tools such as PowerBI, Tableau


- Good storytelling skills to present the data in simple and meaningful manner

Data Engineering Skills :

- Strong skill in data analysis techniques to generate finding and insights by means of exploratory data analysis

- Good understanding of how to transform and connect the data of various types and form

- Great numerical and analytical skills

- Identify opportunities for data acquisition

- Explore ways to enhance data quality and reliability

- Build algorithms and prototypes

- Reformulating existing frameworks to optimize their functioning.

- Good understanding of optimization techniques to make the system performant for requirements.

(ref:hirist.tech)
  • Senior Data Engineer

    3 weeks ago


    Overseas/International, IN Freelancer HR Full time

    Job Description Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with connectivity...


  • Malaysia/Overseas/International, India Amk technologies Full time

    About the job:- Work experience in being Senior BI engineer role- Work closely with internal and external stakeholders to turn data into critical information and knowledge that can be used to make sound business decisions- Responsible for the full life cycle development, implementation, production support, and performance tuning of the Enterprise Data...

  • Data Engineer

    1 month ago


    Overseas,International,Philadelphia, India IT Full time

    About the job :Job Description:- Utilize PySpark and SQL programming languages to develop and maintain data pipelines for processing and analyzing large datasets.- Work on-site from day one, collaborating closely with the team in a fast-paced environment.- Preferably have experience in the Telecom domain to understand and address domain-specific challenges...


  • Singapore/Overseas/International, India Sourceone Staffing & Consulting Pvt Ltd Full time

    Data Platform Support EngineerLocation : SingaporeTeam/ Competency : Production SupportCore Skillsets : Service Delivery, Batch scheduling and monitoring, ETL Development, SQLHigh Level Job Scope : Production SupportJob Description : Big Data Support EngineerSkillset :- Up to 9 years of IT experience & 5+ Years on Hadoop and K8s Eco Systems- Last 3 years of...


  • Overseas/International, IN JTek Software Solutions Pvt Ltd Full time

    Role : Data StewardLocation : USExperience : 5-8 YrsWhat You'll Do :We're setting up a new role to support the improvement and quality of our data in the North America region. The North America Data Steward will act as the go-to person to ensure data quality, completeness, and accuracy from several data sources.Key Responsibilities :This person will...


  • Overseas/International, India JTek Software Solutions Pvt Ltd Full time

    Role : Data StewardLocation : USExperience : 5-8 Yrs What You'll Do :We're setting up a new role to support the improvement and quality of our data in the North America region. The North America Data Steward will act as the go-to person to ensure data quality, completeness, and accuracy from several data sources.Key Responsibilities :This person...


  • Overseas,International, India BlueByte Technologies Full time

    Role : Gen AI engineer Location : Dubai UAE Duration : 12+ months Job Description :You must have skills :- At least 7 years of experience in full stack development with high-quality, clean, and maintainable code, including both front-end and back-end development.- Proven experience in developing and deploying generative AI models for real-world...

  • Diatoz Solutions

    2 weeks ago


    Dubai/Overseas/International, India Diatoz Solutions Pvt Ltd Full time

    Role : Senior Software EngineerExperience : 5-8 years Skill : DevOpsDescription : The ideal candidate will have experience in implementing automated CI/CD pipelines for software delivery and deployment processes on cloud : - Design and implement CI/CD pipelines to automate software delivery and deployment processes- Design, implement, and manage scalable...

  • Web Synergies

    4 weeks ago


    Overseas/International, India Web Synergies (India) Pvt Ltd Full time

    Web Synergies is an IT Solutions and Services company assessed at CMMI DEV/3 (Level 3) and CMMI SVC/3 (Level 3). We are headquartered in Singapore, since 1998, with an Offshore Development Centre in Hyderabad, India, since 2000.You can find out more about us @ Job Description :Experience : 7 +Location : In India (Bangalore) & Middle east Asia (Oman)Notice...


  • Overseas/International/Sydney,Australia,Melbourne, India IT Full time

    About the job : Senior Software DeveloperLocation : Melbourne/ Sydney Job Description :We are seeking a talented and experienced Senior Software Engineer to join our dynamic team.- The ideal candidate will have over 10 years of experience in software development with expertise in Java, Spring, Springboot, Microservices, React, and Python.- As a Senior...

  • Indus International

    1 month ago


    Overseas/International, India iimjobs Full time

    Job Title:Sales Application Engineer:Indus International - UAE Location: Sharjah, UAE (20 minutes from Dubai)About Indus International: Indus International is a leading manufacturer of heat exchangers with a strong global presence. We are committed to delivering innovative and high-quality solutions to our clients across HVAC, refrigeration, and heat pump...


  • US/Overseas/International, India procal tech Full time

    Job Title : Data Scientist No. of Positions : 2 Location : Bedminster - NJ Experience : 7 to 10 years Working Model : Hybrid Job Overview : As a Data Scientist at Procal, you will be responsible for analyzing large, complex datasets and identifying meaningful patterns that lead to actionable recommendations. You will be performing thorough testing and...


  • Chennai,Overseas,International,Thailand, India Scripting Resumes Full time

    Senior Business Analyst-Insurance Domain, a Full Time role in Chennai and willing to travel onsite to Thailand in understanding the project requirements ,client looking for immediate joiner for this role Role : Senior Business Analyst - Insurance Domain Job Type : Full Time Job Positions : 1Location : Chennai/Thailand Job Description : - 8+ years of...

  • Senior Developer

    1 month ago


    Dubai,Overseas,International, India CLOUD DESK TECHNOLOGY PRIVATE LIMITED Full time

    Position - Salesforce Developer SeniorCompany Name - Cloud Desk TechnologyYears of Experience - 4 to 9 yearsJob Details :- Experience in developing Salesforce customization projects, integrations, and developing and executing data migrations.- Experience creating the technical solution for complex Salesforce implementations.- Experience in technology...

  • Tech lead Java

    1 month ago


    Overseas,International, India Dow Technologies and Systems Full time

    Job Description : Role : Web API & Microservices Technical Development Manager- Serve as technical development lead to implement Enterprise Web API, Microservices and Data Modelling for the Bank with full capability /accountability for architecture deliverables (process, information, technology etc.) from concept to implementation - Communicate and...

  • React.js Developer

    4 weeks ago


    Overseas/International, India Easy Recruitz Full time

    Responsibilities : Lead and mentor a team of frontend engineers, driving excellence in coding practices, design patterns, and software architecture. Collaborate closely with cross-functional teams, including product managers, designers, and backend engineers, to deliver high-quality, scalable, and performant frontend solutions. Architect, develop, and...


  • Overseas/International, India Sampoorna Consultants Pvt. Ltd Full time

    Job Location : FIJI Job Description : Our client if looking for Chief Information Officer who will be responsible for management, implementation, and usability of information and computer technologies, including :- Development and implementation of Group strategies and policies on Information Technology aligned with business strategy with a long-term...

  • Senior Data Analyst

    1 month ago


    Overseas,International,Saudi Arabia, India Insight Advisors Private Limited Full time

    Requirement in Internal Audit Firm based out of Jordan (Saudi)Position : Sr. Data AnalystQualification : BSc (Data Sci/Comp Sci/ IT)Experience : (3-5)yrsWorking days : Sunday - Thursday Shift Timing : 8.30AM - 5.30PMkey skills : Business intelligence, Power BI, Visualization, Data analytics, Ui Path, CaseWare IDEAFrequently travel is a must from Saudi to...

  • Senior Engineer

    2 weeks ago


    Saudi Arabia/Overseas/International/Middle East, India Right Advisors Private Limited Full time

    Senior Engineer - Instrument SAP/System Applications & ProductsKey Responsibilities :SAP Implementation and Configuration : - Lead the implementation and configuration of the Instrumentation module within the SAP system. - Define system requirements, design data structures, configure master data, and customize functionalities to meet business...

  • Software Engineer

    4 weeks ago


    Overseas,International, India DBP Offshore pvt ltd Full time

    This Role is for Sydney Australia so only Australian Permanent Residents or Citizens apply.About Us :Client is the worldwide leading provider of both cloud and on-premises enterprise software solutions that empower organizations to make smarter decisions based on advanced analytics of structured and unstructured data. Client helps organizations of all sizes...