Data Engineer
3 days ago
Company Description
Woodfrog is a comprehensive data solutions provider, offering expertise in data engineering, analytics, machine learning, and large language models. We help organizations streamline data operations, bridge skill gaps, and accelerate their data-driven journey. Our integrated solutions enable businesses to unify disparate data sources, gain real-time visibility, drive innovation, and make data-informed decisions with confidence. By partnering with Woodfrog, enterprises can transform their data into a strategic asset, driving growth, efficiency, and competitiveness.
Job Summary:
We're seeking an experienced Data Engineer, Automation, & DevOps Expert to join our team. The ideal candidate will have a strong background in data pipelines development, containerization, deployment, automation, and DevOps. The successful candidate will be responsible for designing, developing, and deploying data pipelines, automating data workflows, and ensuring smooth deployment and operation of data systems.
Key Responsibilities:
- Data Pipelines Development (30%):
- Design, develop, and deploy data pipelines using various tools and technologies
- Collaborate with data scientists and analysts to integrate data pipelines with data models and analytics tools
- Optimize data pipelines for performance, scalability, and reliability
- Containerization & Deployment (30%):
- Design and implement containerization strategies using Docker, Kubernetes, or other containerization tools
- Develop and deploy data applications using containerization and orchestration tools
- Ensure smooth deployment and operation of data systems
- Data Automation (20%):
- Automate data workflows using various automation tools and technologies
- Collaborate with data scientists and analysts to automate data processing and analytics tasks
- Optimize data automation workflows for performance, scalability, and reliability
- Research & Innovation (10%):
- Stay up-to-date with the latest advancements in data engineering, automation, and DevOps
- Research and develop new techniques and tools to drive innovation
- Collaborate with cross-functional teams to identify opportunities for innovation
- Customer Facing & Design Prototype (10%):
- Collaborate with customers to understand their requirements and provide product demos
- Develop design prototypes to visualize and test data pipelines and automation workflows
- Gather feedback and iterate on data pipeline and automation workflow development
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
- 4+ years of experience in data engineering, automation, and DevOps
- Strong background in data pipelines development, containerization, deployment, automation, and DevOps
- Experience with various data technologies such as Apache Beam, Apache Spark, Apache Kafka, and others
- Experience with containerization tools such as Docker, Kubernetes, and others
- Experience with automation tools such as Apache Airflow, Zapier, and others
- Strong programming skills in languages such as Python, Java, Scala, and others
- Strong understanding of data architecture, data modeling, and data governance
- Excellent communication and collaboration skills
Nice to Have:
- Experience with cloud-based technologies such as AWS, Azure, GCP, and others
- Familiarity with agile development methodologies
- Experience with data visualization tools such as Tableau, Power BI, and others
- Familiarity with machine learning and artificial intelligence concepts
What We Offer:
- Competitive salary and benefits package
- Opportunity to work on challenging projects with a talented team
- Professional development and growth opportunities
- - Flexible working hours and remote work options
-
india Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
14 hours ago
India Data Warehouse Engineer Full timeExperience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Expert for Analytics Projects
1 hour ago
India Data Warehouse Engineer Full timeAbout the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
3 days ago
India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...
-
Lead data engineer
1 week ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Lead Data Engineer
2 weeks ago
India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Lead Data Engineer
2 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Aws data engineer
5 days ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
4 weeks ago
india ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Lead Data Engineer: Strategic Data Architect
2 weeks ago
India Wavicle Data Solutions Full timeWavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
india Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
Data engineer
1 month ago
India Ryden Global Full timeWe're #hiring #Data Engineers for our USA based client at offshore in India (must support afternoon shift in IST). Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics...
