Data Engineer

2 weeks ago

Bengaluru, Karnataka, India Gethyr Full time

We are looking for a skilled Data Engineer with a focus on stream processing to join our team and work on exciting projects. As a Data Engineer, you will be responsible for designing and optimizing stream processing pipelines using Apache Flink and Kafka, among other technologies, to handle real-time data efficiently. Here are some key responsibilities and qualifications for this role:

  • Stream Processing Development: Design, develop, and optimize stream processing pipelines using Apache Flink and Kafka.
  • Data Ingestion: Implement robust data ingestion pipelines to collect, process, and distribute streaming data into the Flink and Kafka ecosystems.
  • Data Transformation: Perform data transformation and enrichment operations on streaming data using Spark Streaming and other technologies.
  • Performance Optimization: Continuously optimize stream processing pipelines for performance, scalability, and reliability.
  • Monitoring and Troubleshooting: Monitor stream processing jobs, troubleshoot issues, and implement necessary optimizations.
  • Integration with AWS Services: Leverage AWS technologies such as Amazon Kinesis, AWS Lambda, Amazon EMR to build end-to-end stream processing solutions.
  • Data Governance and Security: Implement data governance and security measures to ensure compliance with regulatory requirements.
  • Collaboration: Collaborate with cross-functional teams to understand requirements and deliver impactful solutions.
  • Documentation: Create and maintain comprehensive documentation for stream processing pipelines.
  • Continuous Learning: Stay updated with the latest advancements in stream processing technologies and best practices.

Qualifications:

  • - Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • - 2-5 years of experience in data engineering roles with a focus on stream processing.
  • - Proficiency in Apache Flink and Kafka.
  • - Hands-on experience with Spark and Spark Streaming.
  • - Strong understanding of cloud computing platforms, particularly AWS services.
  • - Proficiency in programming languages such as Java, Scala, or Python.
  • - Experience with containerization and orchestration tools like Docker and Kubernetes is a plus.
  • - Excellent problem-solving skills and strong communication abilities.

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python8 to 13 years of experience in Data engineeringExtensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)Hands-on experience in SnowflakeProficient in Data Pipeline OrchestrationProficient in any one of the programing languages (python or...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story of...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or go)...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on Apache Spark or...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years' experience on Apache Spark or Azure...

  • Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description: Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at SalesforceWe are seeking a Data Modeler...

  • Data Analyst

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Analyst - Python, PowerBI to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Position:...

  • Digital Engineering Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionWe are looking for a skilled and motivated Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India. If you are passionate about data solutions and enjoy working with cutting-edge technologies, this might be the perfect opportunity for you.Implement data storage solutions and optimize data processing using...

  • Digital Engineering Sr. Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID:274457NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Description: Data ArchitectSummary:Do...

  • Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    We are currently seeking a Data Scientist - Supply Chain Analytics to join our team in Bengaluru, Karnātaka (IN-KA), India (IN).Chainalytics, part of NTT DATA, accelerates fact-based transformation for supply chain leaders around the world. Providing world-class consulting and managed analytics services, our competencies are powered by an unrivaled passion...

  • Senior Engineering Manager

    2 weeks ago

    Bengaluru, Karnataka, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes.There has been a fundamental change in the amount of data companies are generating on a day-to-day basis.More and more users in an organization are now looking to use data to drive business decisions.Data is no longer a second-class...

  • Digital Engineering Sr. Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Digital Engineering Sr. Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....

  • Data Analyst

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analyst - Python, PowerBI to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Position: Data...

  • Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionNTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer (React) to join our team in Bangalore, Karnātaka (IN-KA), India (IN).React Full stack: React...