Data Engineer

3 weeks ago

india Yellow.ai Full time

Responsibilities:


Data Pipeline Development:

  • Assist in designing and building scalable ETL/ELT pipelines using tools.
  • Participate in the development and maintenance of data processing workflows, ensuring data accuracy and reliability.
  • Collaborate with the team to implement real-time and batch data solutions that meet business requirements.


Open-Source Tool Integration:

  • Contribute to the integration and optimization of open-source data engineering tools.
  • Work on integrating and managing databases to support various applications.
  • Stay engaged with new developments in open-source technologies and bring innovative ideas to the team.


Collaboration and Learning:

  • Work closely with senior engineers and data scientists to understand data requirements and translate them into technical solutions.
  • Engage in code reviews, pair programming, and team discussions to continuously improve your skills and contribute to the team's success.
  • Actively participate in team meetings and share your insights to help solve technical challenges.


System Monitoring and Improvement:

  • Monitor the performance of data systems and pipelines, identifying and addressing any issues proactively.
  • Contribute to the ongoing optimization of data systems for better performance, scalability, and cost-efficiency.
  • Help implement best practices in data governance, security, and documentation.


Requirements:

  • Education: Bachelor's degree in Computer Science.
  • 3-5 years of experience in software development and data engineering.
  • Hands-on experience with open-source data pipeline tools.
  • Strong programming skills in languages like NodeJs, Golang, and Java.
  • Proficiency in SQL and experience with both relational and NoSQL databases.
  • Solid understanding of data warehousing concepts, ETL processes, and data modeling.
  • Experience with CI/CD pipelines, containerization, and orchestration tools.
  • Strong problem-solving skills and a willingness to learn and adapt in a dynamic environment.
  • Excellent communication skills, with the ability to work collaboratively in a fast-paced, team-oriented environment.

  • Senior Data Integration Engineer | Senior Data Integration Engineer | india

    14 hours ago

    india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer | Senior Data Integration Engineer | india

    20 hours ago

    india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    4 hours ago

    India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...

  • Lead data engineer

    6 days ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Lead Data Engineer

    2 weeks ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    2 weeks ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Aws data engineer

    3 days ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 weeks ago

    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    3 weeks ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Lead Data Engineer: Strategic Data Architect

    2 weeks ago

    India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...

  • Wavicle Data Solutions | Lead Data Engineer | india

    2 weeks ago

    india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...

  • Wavicle Data Solutions | Lead Data Engineer | india

    2 weeks ago

    india Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Wavicle Data Solutions | Lead Data Engineer | india

    2 weeks ago

    india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...

  • Data engineer

    1 month ago

    India Ryden Global Full time

    We're #hiring #Data Engineers for our USA based client at offshore in India (must support afternoon shift in IST).  Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics...

  • Data Engineer

    1 month ago

    india Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST). Role DescriptionThis is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    1 month ago

    India Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST).  Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    1 month ago

    india Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST).  Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...