Data Engineer
2 weeks ago
Company Description
Woodfrog is a comprehensive data solutions provider, offering expertise in data engineering, analytics, machine learning, and large language models. We help organizations streamline data operations, bridge skill gaps, and accelerate their data-driven journey. Our integrated solutions enable businesses to unify disparate data sources, gain real-time visibility, drive innovation, and make data-informed decisions with confidence. By partnering with Woodfrog, enterprises can transform their data into a strategic asset, driving growth, efficiency, and competitiveness.
Job Summary:
We're seeking an experienced Data Engineer, Automation, & DevOps Expert to join our team. The ideal candidate will have a strong background in data pipelines development, containerization, deployment, automation, and DevOps. The successful candidate will be responsible for designing, developing, and deploying data pipelines, automating data workflows, and ensuring smooth deployment and operation of data systems.
Key Responsibilities:
- Data Pipelines Development (30%):
- Design, develop, and deploy data pipelines using various tools and technologies
- Collaborate with data scientists and analysts to integrate data pipelines with data models and analytics tools
- Optimize data pipelines for performance, scalability, and reliability
- Containerization & Deployment (30%):
- Design and implement containerization strategies using Docker, Kubernetes, or other containerization tools
- Develop and deploy data applications using containerization and orchestration tools
- Ensure smooth deployment and operation of data systems
- Data Automation (20%):
- Automate data workflows using various automation tools and technologies
- Collaborate with data scientists and analysts to automate data processing and analytics tasks
- Optimize data automation workflows for performance, scalability, and reliability
- Research & Innovation (10%):
- Stay up-to-date with the latest advancements in data engineering, automation, and DevOps
- Research and develop new techniques and tools to drive innovation
- Collaborate with cross-functional teams to identify opportunities for innovation
- Customer Facing & Design Prototype (10%):
- Collaborate with customers to understand their requirements and provide product demos
- Develop design prototypes to visualize and test data pipelines and automation workflows
- Gather feedback and iterate on data pipeline and automation workflow development
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
- 4+ years of experience in data engineering, automation, and DevOps
- Strong background in data pipelines development, containerization, deployment, automation, and DevOps
- Experience with various data technologies such as Apache Beam, Apache Spark, Apache Kafka, and others
- Experience with containerization tools such as Docker, Kubernetes, and others
- Experience with automation tools such as Apache Airflow, Zapier, and others
- Strong programming skills in languages such as Python, Java, Scala, and others
- Strong understanding of data architecture, data modeling, and data governance
- Excellent communication and collaboration skills
Nice to Have:
- Experience with cloud-based technologies such as AWS, Azure, GCP, and others
- Familiarity with agile development methodologies
- Experience with data visualization tools such as Tableau, Power BI, and others
- Familiarity with machine learning and artificial intelligence concepts
What We Offer:
- Competitive salary and benefits package
- Opportunity to work on challenging projects with a talented team
- Professional development and growth opportunities
- - Flexible working hours and remote work options
-
india Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
2 weeks ago
India Data Warehouse Engineer Full timeExperience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Expert for Analytics Projects
2 weeks ago
India Data Warehouse Engineer Full timeAbout the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 weeks ago
India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...
-
Cloud Data Engineering Lead
1 week ago
India ITI Data Full timeITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...
-
ITI Data | PySpark Data Engineer
1 day ago
india ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...
-
Lead data engineer
3 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Lead Data Engineer
4 weeks ago
India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Lead Data Engineer
4 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Aws data engineer
2 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Data Platform Engineer
3 days ago
India OSD Data Services Full timeData Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Data Platform Engineer
4 days ago
India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
AWS Data Engineer
4 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 months ago
India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
1 month ago
india ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Lead Data Engineer: Strategic Data Architect
4 weeks ago
India Wavicle Data Solutions Full timeWavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...