Data Engineer

3 weeks ago

Navi Mumbai, India R3 Consultant Full time
Essential Duties and Responsibilities:Create and maintain optimal data pipeline architectureAssemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, and scripting toolsEnsure that data transformations are well documented follow best practices and understood by business users and developersUnderstand the relationships across business information and units of data, Reverse engineer data from various source systems.

Technical Skills:Working with cloud services, data lake storage, Hadoop, Spark, Python/ Scala, Hive, HDFS, SQL and No-SQL databases.Knowledge on creating Batch or Realtime Data pipelines with on-premise or different cloud services, ETL tools and Kafka etc.Performance optimization of complex ETL mappings for relational and non-relational workloads.Hands on Unix scripting or PowerShell.Develop data warehouse model, ensuring data design follows the prescribed reference architecture framework while reflecting appropriate business rules built for logical, physical and conceptual model.Knowledge on setting up code versioning with GitHub and CICD pipelines.Experience with data pipeline and workflow management tools: Azkaban, Luigi, AirflowExperience with big data tools: Hadoop, Spark or Kafka

Education background:Mandatory (if any):

Graduate Degree in Computer Science or equivalentDesirable (if any):

Strong exposure in programming languages

(Python / Scala, SQL)Preferred Experience (Industry/therapy/function no. of years): 1-3 yearsKnowledge of big data in pharmaceutical fieldProduct thinking, capable of assessing requirements from a users standpoint

  • Data Engineer

    2 weeks ago

    navi mumbai, India Manufacturing MNC Full time

    Location-Navi Mumbai- PreferredBangaloreRequirement-Looking for Data Engineer with SAP experience3-5 years of ExperienceBachelors or master's in technology or engineeringStrong knowledge on Data Engineering aspectsImplementing methods to improve data reliability and quality.Combining raw information from different sources to create consistent and...

  • Data Engineer

    4 weeks ago

    Navi Mumbai, India Manufacturing MNC Full time

    Location-Navi Mumbai- PreferredBangaloreRequirement-Looking for Data Engineer withSAPexperience3-5 years of ExperienceBachelors or master's in technology or engineeringStrong knowledge on Data Engineering aspectsImplementing methods to improve data reliability and quality.Combining raw information from different sources to create consistent and...

  • Data Engineer

    4 weeks ago

    Navi Mumbai, India Manufacturing MNC Full time

    Location-Navi Mumbai- PreferredBangaloreRequirement-Looking for Data Engineer with SAP experience 3-5 years of Experience Bachelors or master's in technology or engineeringStrong knowledge on Data Engineering aspectsImplementing methods to improve data reliability and quality.Combining raw information from different sources to create consistent and...

  • Data Engineer

    1 month ago

    Navi Mumbai, India Manufacturing MNC Full time

    Location-Navi Mumbai- PreferredBangaloreRequirement-Looking for Data Engineer with SAP experience 3-5 years of Experience Bachelors or master's in technology or engineeringStrong knowledge on Data Engineering aspectsImplementing methods to improve data reliability and quality.Combining raw information from different sources to create consistent and...

  • Data Engineer

    4 weeks ago

    Navi Mumbai, India Manufacturing MNC Full time

    Location- Navi Mumbai- Preferred Bangalore Requirement- Looking for Data Engineer with SAP experience 3-5 years of Experience Bachelors or master's in technology or engineering Strong knowledge on Data Engineering aspects Implementing methods to improve data reliability and quality. Combining raw information from different sources to create consistent...

  • Network Security Engineer

    4 weeks ago

    navi mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEWBig Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing and expanding footprints in SEA regions.Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions...

  • Senior Data Engineer

    6 days ago

    Navi Mumbai, Maharashtra, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...

  • Senior Data Engineer

    6 days ago

    Navi Mumbai, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...

  • Network Security Engineer

    4 weeks ago

    Navi Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEW Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions...

  • Network Security Engineer

    4 weeks ago

    navi mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEW Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect...

  • Network Security Engineer

    1 month ago

    Navi Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEWBig Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing and expanding footprints in SEA regions.Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Network Security Engineer

    4 weeks ago

    Navi Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEWBig Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing and expanding footprints in SEA regions.Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • [13/05/2024] Network Security Engineer

    3 days ago

    Navi Mumbai, India BDx Data Centers Full time

    COMPANY OVERVIEWBig Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing and expanding footprints in SEA regions.Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Data and Infrastructure Engineer

    4 weeks ago

    Navi Mumbai, India SLB Full time

    Data and Infrastructure Engineer WHO ARE WE? With a history and culture of science and innovation, we’re the world’s leading provider of technology and services to the energy industry across the world. Throughout much of the oil and gas lifecycle in over 120 countries, we design, develop, and deliver technology that transforms how work is done....

  • Data and Infrastructure Engineer

    3 weeks ago

    navi mumbai, India SLB Full time

    Data and Infrastructure Engineer WHO ARE WE? With a history and culture of science and innovation, we’re the world’s leading provider of technology and services to the energy industry across the world. Throughout much of the oil and gas lifecycle in over 120 countries, we design, develop, and deliver technology that transforms how work is...

  • Data and Infrastructure Engineer

    3 weeks ago

    Navi Mumbai, India SLB Full time

    Data and Infrastructure EngineerWHO ARE WE?With a history and culture of science and innovation, we’re the world’s leading provider of technology and services to the energy industry across the world. Throughout much of the oil and gas lifecycle in over 120 countries, we design, develop, and deliver technology that transforms how work is done. Together,...

  • Senior Backend Data Engineer

    3 weeks ago

    Mumbai/Navi Mumbai, Maharashtra, India Looper Development Services Private Limited Full time

    Job Description :- Bachelor's or advanced degree in Computer Science, Information Technology, or related field.- Proven experience as a Back-End Data Engineer or similar role.- Proficiency in database design and management (e.g., SQL, NoSQL).- Strong programming skills in languages such as Python, Java, or Scala.- Experience with ETL tools and data...

  • Senior Backend Data Engineer

    2 weeks ago

    Mumbai/Navi Mumbai, India Looper Development Services Private Limited Full time

    Job Description : - Bachelor's or advanced degree in Computer Science, Information Technology, or related field.- Proven experience as a Back-End Data Engineer or similar role.- Proficiency in database design and management (e.g., SQL, NoSQL).- Strong programming skills in languages such as Python, Java, or Scala.- Experience with ETL tools and data...

  • Data Engineer

    2 days ago

    mumbai, India SparkNet Innovations Full time

    Company DescriptionSparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...

  • Data Engineer

    5 days ago

    Mumbai, India Newfold Digital Full time

    Data EngineerJOB DESCRIPTIONNewfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data Warehouses...