Data Engineer
1 month ago
Job Description :
Role Objective :
Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams.
The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building.
The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products.
Roles & Responsibilities :
- Sound knowledge in Spark architecture and distributed computing.
- Proficient in Spark including RDD and Dataframes core functions, troubleshooting and performance tuning.
- Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
- Good in functional programming and OOPS concept on Scala.
- Good experience in SQL and should be able to write complex queries.
Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
- Able to mentor new members for onboarding to the project.
- Understand the client requirement and able to design, develop from scratch and deliver.
- AWS cloud experience would be preferable.
- Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services DynamoDB, RedShift, Kinesis, Lambda, S3, etc (prefered).
- Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (prefered).
- Experience in analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS(prefered).
- Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
- Managing project timing, client expectations and meeting deadlines.
- Should have played project and team management roles.
- Facilitate meetings within the team on regular basis.
- Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
- Optimization, maintenance, and support of pipelines.
- Strong analytical and logical skills.
- Ability to comfortably tackling new challenges and learn.
Expertise And Qualifications :
Must have Skills :
- Scala.
- Spark.
- AWS preferable/Any cloud.
- SQL (Intermediate to advanced level).
- Object-Oriented Programming.
- Good knowledge on ETL/ELT processes and tools.
Good to Have Skills :
- AWS Certification.
- Basic knowledge of streaming.
- Knowledge on hive, Hadoop, Kafka, Streaming.
- Git/similar version control tool.
- Knowledge in CI/CD, Microservices
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations Aricent Full timeJob Profile : Data EngineerAt Aricent, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and develop scalable data architectures using Azure Data Factory, Azure Data Bricks, and other related...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations beansbit Full timeSalary : 25 - 40 LPA Job Description : We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations Symphoni HR Full timeJob Title: Data EngineerAt Symphoni HR, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining robust data pipelines and data warehouses.Key Responsibilities:Design and develop scalable data pipelines using Snowflake and other relevant tools.Extract,...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations IT Source Global Full timeJob Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at IT Source Global. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and ETL/ELT workflows using PySpark, Python, and SQL for data extraction, transformation, and loading.Key...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations Info Services Full timeData Engineer RoleWe are seeking a skilled Data Engineer to join our team at Info Services. As a Data Engineer, you will be responsible for designing and implementing efficient data pipelines using big data frameworks (e.g, Spark) for ingesting, transforming, and processing large datasets.Key Responsibilities- Design and implement data pipelines using big...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations Orangeskill Technologies Pvt Ltd Full timeJob Title: Data EngineerAt Orangeskill Technologies Pvt Ltd, we are seeking a highly skilled Data Engineer to design, build, and maintain data pipelines, workflows, and infrastructure to support efficient data processing and analysis.Key Responsibilities:Design and implement data pipelines for large-scale data processing.Develop and manage workflow...
-
Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Orangeskill Technologies Pvt Ltd Full timeJob Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations Hum Technologies Full timeHiring for Data Engineer-Informatica with expertise in Informatica & ETL toolsAbout the Role:We are seeking a skilled Data Engineer to join our team at Hum Technologies. As a Data Engineer, you will be responsible for designing, developing, and implementing ETL processes using Informatica PowerCenter.Responsibilities:Develop and maintain ETL mappings,...
-
Data Engineer for Big Data
4 weeks ago
Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full timeAbout the Role:At D-TechWorks Pvt Ltd, we are seeking a skilled Data Engineer for Big Data to join our team. As a key member of our delivery team, you will be responsible for ensuring effective design, development, validation, and support activities in line with client needs and architectural requirements.About the Position:This is a Remote Big Data Position...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations Symphoni HR Full timeData Engineer Job DescriptionAs a Data Engineer at Symphoni HR, you will play a crucial role in designing, developing, and maintaining robust data pipelines and data warehouses.Key Responsibilities:Design, develop, and implement scalable data pipelines using Snowflake and other relevant tools to transform raw data into valuable insights.Extract, transform,...
-
Data Engineering Specialist
4 weeks ago
Anywhere in India/Multiple Locations DoublU Pty Ltd Full timeJob Title: Data EngineerJob Overview:We at DoublU Pty Ltd are seeking a skilled and experienced Data Engineer to join our dynamic data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures in Google Cloud Platform (GCP).Key Responsibilities:Design, develop, and implement data...
-
Cloud Data Engineer
1 month ago
Anywhere in India/Multiple Locations Naukari Wale Full timeJob Title: Cloud Data EngineerJob Summary:We are seeking a highly skilled Cloud Data Engineer to join our team at Naukari Wale. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on cloud platforms.Key Responsibilities:Design and implement data pipelines using Azure Data Factory and...
-
AWS Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations ARR Recruitment Solutions Full timeData Engineering RoleAt ARR Recruitment Solutions, we're seeking a talented AWS Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data pipelines and ETL processes using AWS services like Glue, Python, Redshift, and Spark.Data Warehousing and MigrationYou will...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations Innotatz IT Solutions Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Innotatz IT Solutions. As a Data Engineer, you will play a crucial role in designing and implementing robust data pipelines to collect, connect, and curate data from various sources.Responsibilities:Design and develop scalable data pipeline architectures to meet...
-
Senior Data Engineer
1 month ago
Anywhere in India/Multiple Locations Infometry Full timeSenior Data EngineerWe are seeking a highly skilled Data Engineer to join our dynamic team at Infometry Inc. As a key member of our data team, you will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using Matillion and Snowflake.Your primary focus will be on collaborating with cross-functional teams to...
-
Senior Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations Techwaukee Full timeJob Title: Lead Data EngineerAt Techwaukee, we are seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data pipelines using BigQuery and KafkaDevelop and...
-
Data Engineering Specialist
4 weeks ago
Anywhere in India/Multiple Locations TalentXO Full timeKey Responsibilities :As a Data Engineering Specialist at TalentXO, you will be responsible for designing and implementing data pipelines using AWS Glue and AWS MWAA (Airflow). You will work collaboratively with cross-functional teams and stakeholders to deliver high-impact data engineering projects.Required Qualifications :7-8 years of experience as a Data...
-
Azure Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations Stratosphere IT Services PVT Ltd Full timeJob Title : Big Data EngineerAzure Data EngineerOverview :We are seeking a highly skilled Big Data Engineer to join our team at Stratosphere IT Services PVT Ltd. As a Big Data Engineer, you will be responsible for designing, building, and maintaining scalable data ingestion pipelines, processing high-performance data, and harmonizing data from various...
-
Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN PureSoftware Pvt Ltd. Full timeWe are seeking a talented and experienced Azure Data Engineer to join our team. As an Azure Data Engineer,Mandatory Skills :- Databricks(PySpark, Scala)- Data Factory/Synapse- SQL DB and DW- Working knowledge on Git Roles and Responsibilities :Requirements :- 4+ years of experience working as a Data Engineer, with a focus on Azure cloud platform.- Good...
-
Data Engineering Lead
1 month ago
Anywhere in India/Multiple Locations Gen Full timeGenpact is a global professional services firm that delivers outcomes that shape the future. Our team of experts is driven by our purpose - the relentless pursuit of a world that works better for people. We serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services,...