Senior Data Engineer

3 weeks ago

OverseasInternational, IN Freelancer HR Full time

Job Description Responsibilities :


- Understand the factories , manufacturing process , data availability and avenues for improvement

- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.

- Define what data is required to create a solution and work with connectivity engineers , users to collect the data

- Create and maintain optimal data pipeline architecture.

- Assemble large, complex data sets that meet functional / non-functional business requirements.

- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery for greater scalability

- Work on data preparation, data deep dive , help engineering, process and quality to understand the process/ machine behavior more closely using available data

- Deploy and monitor the solution

- Work with data and analytics experts to strive for greater functionality in our data systems.

- Work together with Data Architects and data modeling /Competencies :


- Good knowledge of the business vertical with prior experience in solving different use cases in the manufacturing or similar industry


- Ability to bring cross industry learning to benefit the use cases aimed at improving manufacturing process

Problem Scoping/definition Skills :

- Experience in problem scoping, solving, quantification

- Strong analytic skills related to working with unstructured datasets.

- Build processes supporting data transformation, data structures, metadata, dependency and workload management.

- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores

- Ability to foresee and identify all right data required to solve the problem

Data Wrangling Skills :


- Strong skill in data mining, data wrangling techniques for creating the required analytical dataset


- Experience building and optimizing 'big data' data pipelines, architectures and data sets

- Adaptive mindset to improvise on the data challenges and employ techniques to drive desired outcomes

Programming Skills :

- Experience with big data tools: Spark, Delta, CDC, NiFi, Kafka, etc

- Experience with relational SQL ,NoSQL databases and query languages, including oracle , Hive, sparkQL.

- Experience with object-oriented languages: Scala, Java, C++ Skills :


- Know how of any visualization tools such as PowerBI, Tableau


- Good storytelling skills to present the data in simple and meaningful manner

Data Engineering Skills :

- Strong skill in data analysis techniques to generate finding and insights by means of exploratory data analysis

- Good understanding of how to transform and connect the data of various types and form

- Great numerical and analytical skills

- Identify opportunities for data acquisition

- Explore ways to enhance data quality and reliability

- Build algorithms and prototypes

- Reformulating existing frameworks to optimize their functioning.

- Good understanding of optimization techniques to make the system performant for requirements.

(ref:hirist.tech)

  • Senior Data Engineer

    2 months ago

    Overseas/International, IN Freelancer HR Full time

    Job Description Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with connectivity...

  • Data Platform Support Engineer

    4 weeks ago

    Singapore/Overseas/International, IN Sourceone Staffing & Consulting Pvt Ltd Full time

    Data Platform Support EngineerLocation : SingaporeTeam/ Competency : Production SupportCore Skillsets : Service Delivery, Batch scheduling and monitoring, ETL Development, SQLHigh Level Job Scope : Production SupportJob Description : Big Data Support EngineerSkillset :- Up to 9 years of IT experience & 5+ Years on Hadoop and K8s Eco Systems- Last 3 years of...

  • JTek Software Solutions

    1 month ago

    Overseas/International, IN JTek Software Solutions Pvt Ltd Full time

    Role : Data StewardLocation : USExperience : 5-8 YrsWhat You'll Do :We're setting up a new role to support the improvement and quality of our data in the North America region. The North America Data Steward will act as the go-to person to ensure data quality, completeness, and accuracy from several data sources.Key Responsibilities :This person will...

  • JTek Software Solutions

    3 weeks ago

    Overseas/International, IN JTek Software Solutions Pvt Ltd Full time

    Role : Data StewardLocation : USExperience : 5-8 YrsWhat You'll Do :We're setting up a new role to support the improvement and quality of our data in the North America region. The North America Data Steward will act as the go-to person to ensure data quality, completeness, and accuracy from several data sources.Key Responsibilities :This person will...

  • Senior Data Engineer

    4 weeks ago

    Riyadh/Overseas/International, IN Syllogistics.ai Full time

    Responsibilities : - Identifying and extracting data from various sources (such as databases, APIs, logs, files, and external systems).- Ensuring data quality during extraction and handling any anomalies.- Transforming raw data into a structured format suitable for analysis and reporting.- Cleaning, aggregating, and enriching data using ETL tools and...

  • Diatoz Solutions

    1 month ago

    Dubai/Overseas/International, IN Diatoz Solutions Pvt Ltd Full time

    Role : Senior Software EngineerExperience : 5-8 years Skill : DevOpsDescription : The ideal candidate will have experience in implementing automated CI/CD pipelines for software delivery and deployment processes on cloud : - Design and implement CI/CD pipelines to automate software delivery and deployment processes- Design, implement, and manage scalable and...

  • Diatoz Solutions

    3 weeks ago

    Dubai/Overseas/International, IN Diatoz Solutions Pvt Ltd Full time

    Role : Senior Software EngineerExperience : 5-8 years Skill : DevOpsDescription : The ideal candidate will have experience in implementing automated CI/CD pipelines for software delivery and deployment processes on cloud : - Design and implement CI/CD pipelines to automate software delivery and deployment processes- Design, implement, and manage scalable and...

  • Functional Test Engineer

    1 week ago

    Overseas/International, IN Growel Softech Pvt. Ltd. Full time

    Job Description :Mandatory Skills : Functional Testing, Manhattan Configuration, WMS Functional Analyst.Location - Any UST location.WMS Functional/Reports Analyst : - WMS : Warehouse Management System SUMMARY Albertsons Company Incorporated is looking for the Manhattan WMS (Warehouse Management System) - Analyst responsible for the testing, configuration,...

  • PL-SQL Developer

    4 weeks ago

    Overseas/International, IN KARPIRA Full time

    Occupations: PL/SQL Developer wanted for Germany Job Description: On behalf of the Client, an Industrial group in Germany, we seek a high-achieving PL/SQL Developer. Responsibilities: - ETL Design and Development - Further development of complex calculating engines with Oracle PL/SQL in the automotive field - SQL performance tuning Requirements: - A...

  • Chief Information Officer

    2 months ago

    Overseas/International, IN Sampoorna Consultants Pvt. Ltd Full time

    Job Location : FIJIJob Description :Our client if looking for Chief Information Officer who will be responsible for management, implementation, and usability of information and computer technologies, including :- Development and implementation of Group strategies and policies on Information Technology aligned with business strategy with a long-term vision.-...

  • Chief Information Officer

    3 weeks ago

    Overseas/International, IN Sampoorna Consultants Pvt. Ltd Full time

    Job Location : FIJIJob Description :Our client if looking for Chief Information Officer who will be responsible for management, implementation, and usability of information and computer technologies, including :- Development and implementation of Group strategies and policies on Information Technology aligned with business strategy with a long-term vision.-...

  • Senior Business Analyst

    2 months ago

    Chennai/Overseas/International/Thailand, IN Scripting Resumes Full time

    Senior Business Analyst-Insurance Domain, a Full Time role in Chennai and willing to travel onsite to Thailand in understanding the project requirements ,client looking for immediate joiner for this role Role : Senior Business Analyst - Insurance Domain Job Type : Full Time Job Positions : 1Location : Chennai/Thailand Job Description :- 8+ years of total...

  • Senior Data Analyst

    2 months ago

    Overseas/International/Saudi Arabia, IN Insight Advisors Private Limited Full time

    Requirement in Internal Audit Firm based out of Jordan (Saudi)Position : Sr. Data AnalystQualification : BSc (Data Sci/Comp Sci/ IT)Experience : (3-5)yrsWorking days : Sunday - Thursday Shift Timing : 8.30AM - 5.30PMkey skills : Business intelligence, Power BI, Visualization, Data analytics, Ui Path, CaseWare IDEAFrequently travel is a must from Saudi to...

  • Senior Data Analyst

    3 weeks ago

    Overseas/International/Saudi Arabia, IN Insight Advisors Private Limited Full time

    Requirement in Internal Audit Firm based out of Jordan (Saudi)Position : Sr. Data AnalystQualification : BSc (Data Sci/Comp Sci/ IT)Experience : (3-5)yrsWorking days : Sunday - Thursday Shift Timing : 8.30AM - 5.30PMkey skills : Business intelligence, Power BI, Visualization, Data analytics, Ui Path, CaseWare IDEAFrequently travel is a must from Saudi to...

  • Mentorpal.ai - Staff Backend Performance Engineer - Java/Spring

    1 week ago

    Overseas/International, IN Mentorpal.ai Full time

    Skills :- MongoDB- PostgreSQL- DevOps- Spring WebFluxThe Role :Who we are :Appsmith is an open-source, low-code platform that helps developers build applications quickly, usually within hours. Since its inception, Appsmith has gained significant traction, with over 10 million downloads, more than 30,000 stars on GitHub, and adoption by 10,000+ organisations...

  • Software Engineer

    2 months ago

    Overseas/International, IN DBP Offshore pvt ltd Full time

    This Role is for Sydney Australia so only Australian Permanent Residents or Citizens apply.About Us :Client is the worldwide leading provider of both cloud and on-premises enterprise software solutions that empower organizations to make smarter decisions based on advanced analytics of structured and unstructured data. Client helps organizations of all sizes...

  • Software Engineer

    3 weeks ago

    Overseas/International, IN DBP Offshore pvt ltd Full time

    This Role is for Sydney Australia so only Australian Permanent Residents or Citizens apply.About Us :Client is the worldwide leading provider of both cloud and on-premises enterprise software solutions that empower organizations to make smarter decisions based on advanced analytics of structured and unstructured data. Client helps organizations of all sizes...

  • Diatoz Solutions

    1 month ago

    Dubai/Overseas/International, IN Diatoz Solutions Pvt Ltd Full time

    List of Skills Required :- Experience in Oracle SQL and PL/SQL.- Advanced PLSQL Programming, Collections and Bulk processing, Analytical functions - SQL query tuning and PL/SQL Performance optimization- Good data analysis skills.- Should be able to understand business requirements and do solution design.- Senior PL/SQL Developer (Database) - Senior Database...

  • Diatoz Solutions

    3 weeks ago

    Dubai/Overseas/International, IN Diatoz Solutions Pvt Ltd Full time

    List of Skills Required :- Experience in Oracle SQL and PL/SQL.- Advanced PLSQL Programming, Collections and Bulk processing, Analytical functions - SQL query tuning and PL/SQL Performance optimization- Good data analysis skills.- Should be able to understand business requirements and do solution design.- Senior PL/SQL Developer (Database) - Senior Database...

  • Senior Engineer

    1 month ago

    Saudi Arabia/Overseas/International/Middle East, IN Right Advisors Private Limited Full time

    Senior Engineer - Instrument SAP/System Applications & ProductsKey Responsibilities :SAP Implementation and Configuration : - Lead the implementation and configuration of the Instrumentation module within the SAP system. - Define system requirements, design data structures, configure master data, and customize functionalities to meet business...