Data Engineer

2 weeks ago


India woodfrog Full time

Company Description

Woodfrog is a comprehensive data solutions provider, offering expertise in data engineering, analytics, machine learning, and large language models. We help organizations streamline data operations, bridge skill gaps, and accelerate their data-driven journey. Our integrated solutions enable businesses to unify disparate data sources, gain real-time visibility, drive innovation, and make data-informed decisions with confidence. By partnering with Woodfrog, enterprises can transform their data into a strategic asset, driving growth, efficiency, and competitiveness.


Job Summary:

We're seeking an experienced Data Engineer, Automation, & DevOps Expert to join our team. The ideal candidate will have a strong background in data pipelines development, containerization, deployment, automation, and DevOps. The successful candidate will be responsible for designing, developing, and deploying data pipelines, automating data workflows, and ensuring smooth deployment and operation of data systems.


Key Responsibilities:

- Data Pipelines Development (30%):

  - Design, develop, and deploy data pipelines using various tools and technologies

  - Collaborate with data scientists and analysts to integrate data pipelines with data models and analytics tools

  - Optimize data pipelines for performance, scalability, and reliability

- Containerization & Deployment (30%):

  - Design and implement containerization strategies using Docker, Kubernetes, or other containerization tools

  - Develop and deploy data applications using containerization and orchestration tools

  - Ensure smooth deployment and operation of data systems

- Data Automation (20%):

  - Automate data workflows using various automation tools and technologies

  - Collaborate with data scientists and analysts to automate data processing and analytics tasks

  - Optimize data automation workflows for performance, scalability, and reliability

- Research & Innovation (10%):

  - Stay up-to-date with the latest advancements in data engineering, automation, and DevOps

  - Research and develop new techniques and tools to drive innovation

  - Collaborate with cross-functional teams to identify opportunities for innovation

- Customer Facing & Design Prototype (10%):

  - Collaborate with customers to understand their requirements and provide product demos

  - Develop design prototypes to visualize and test data pipelines and automation workflows

  - Gather feedback and iterate on data pipeline and automation workflow development


Requirements:

- Bachelor's or Master's degree in Computer Science, Engineering, or related field

- 4+ years of experience in data engineering, automation, and DevOps

- Strong background in data pipelines development, containerization, deployment, automation, and DevOps

- Experience with various data technologies such as Apache Beam, Apache Spark, Apache Kafka, and others

- Experience with containerization tools such as Docker, Kubernetes, and others

- Experience with automation tools such as Apache Airflow, Zapier, and others

- Strong programming skills in languages such as Python, Java, Scala, and others

- Strong understanding of data architecture, data modeling, and data governance

- Excellent communication and collaboration skills


Nice to Have:

- Experience with cloud-based technologies such as AWS, Azure, GCP, and others

- Familiarity with agile development methodologies

- Experience with data visualization tools such as Tableau, Power BI, and others

- Familiarity with machine learning and artificial intelligence concepts


What We Offer:

- Competitive salary and benefits package

- Opportunity to work on challenging projects with a talented team

- Professional development and growth opportunities

  • - Flexible working hours and remote work options


  • india Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.


  • India Data Warehouse Engineer Full time

    Experience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.


  • India Data Warehouse Engineer Full time

    About the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.


  • india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...


  • India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...


  • India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...


  • india ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • Lead data engineer

    3 weeks ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Lead Data Engineer

    4 weeks ago


    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    4 weeks ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Aws data engineer

    2 weeks ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....


  • India OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...


  • India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • AWS Data Engineer

    4 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    4 months ago


    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    1 month ago


    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    4 weeks ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....


  • India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...