Data Engineering Expert for Big Data Solutions
1 day ago
Cynosure Corporate Solutions is seeking a highly skilled Data Engineer to lead our big data solutions team. This role requires expertise in designing, building, and optimizing complex data pipelines using Hadoop/Spark ecosystem.
About the Role:
We are looking for an experienced professional who can work collaboratively with cross-functional teams to deliver high-quality data engineering solutions. The ideal candidate will have a deep understanding of cloud providers such as Azure and AWS, and experience working with various tools like Oozie, Airflow, and Sqoop.
Key Responsibilities:
- Design and develop efficient data structures and pipelines using Spark/Hadoop ecosystem
- Collaborate with UI and development teams to deliver end-to-end data engineering solutions
- Work with clients to understand their data needs and build customized solutions
- Develop programs for cleaning and processing large datasets
- Orchestrate jobs using Oozie and Airflow
- Optimize data pipelines for performance and cost-effectiveness
- Maintain up-to-date code versioning control and git repository
- Communicate effectively with internal and external stakeholders about data pipeline designs and implementations
Requirements:
- Bachelor's degree in Computer Science or related field
- Minimum 5+ years of experience working with Spark/Hadoop ecosystem
- Minimum 4+ years of experience designing data streaming pipelines
- Proven experience with big data ecosystem tools like Sqoop, Spark, SQL, API, Hive, Oozie, Airflow, etc.
- Solid experience in all phases of SDLC (plan, design, develop, test, release, maintain and support)
- Hands-on experience using Azure's data engineering stack
- Experience implementing projects using programming languages like Scala or Python
- Working experience on SQL complex data merging techniques like windowing functions
- Hands-on experience with on-prem distribution tools like Cloudera/Horton Works/MapR
Estimated Salary: $150,000 - $200,000 per year
-
India ITI Data Full timeWe are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
india Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
Big Data Engineer
4 weeks ago
India Pert Telecom Solutions Full timeJob Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential...
-
ITI Data | PySpark Data Engineer
1 day ago
india ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...
-
Lead data engineer
3 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Lead Data Engineer
4 weeks ago
India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Lead Data Engineer
4 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
India LTIMindtree Full timeLTIMindtree is seeking a highly skilled Data Engineering Expert to join our team.Salary: ₹25,00,000 - ₹40,00,000 per annum.Job Description:We are looking for an experienced professional with expertise in designing and developing big data platforms using Scala and Spark.The ideal candidate will have a deep understanding of modern data processing...
-
Lead Data Engineer: Strategic Data Architect
4 weeks ago
India Wavicle Data Solutions Full timeWavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...
-
Data Architect for Big Data Solutions
3 days ago
India Priceline Full timeUnlock Your Potential in a Fast-Paced Fintech EnvironmentWe are seeking an experienced Data Architect to join our Technology team, where you will play a key role in designing and implementing big data solutions that drive business growth.About the Role:Job Summary:This is a high-level position responsible for leading the design, development, and...
-
Big Data Analytics Expert
5 days ago
India LTIMindtree Full timeAre you looking for a challenging role in the field of Big Data?We at LTIMindtree are seeking experienced professionals with strong expertise in Spark/Pyspark/Scala Spark/Java Spark skills.About Our CompanyLTIMindtree is a leading global technology consulting and business solutions company that provides innovative, next-generation IT services to its clients...
-
Big Data Expert for IoT Analytics Solutions
1 week ago
India NCR Voyix Full timeSenior Big Data Engineer PositionWe are seeking an experienced professional to join our team at NCR Voyix as a Senior Big Data Engineer. This is an exciting opportunity to work with cutting-edge technology and contribute to the development of innovative data products that drive business growth.About the RoleThe successful candidate will be responsible for...
-
india Pert Telecom Solutions Full timeJob Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Big Data Developer
7 days ago
India Luxoft Full timeSenior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a key member of our Data Engineering & Analytics team, you will play a crucial role in developing data-driven solutions that drive business growth.About the RoleThis is an exciting opportunity for a seasoned data engineer to leverage their...
-
Data Platform Engineer
3 days ago
India OSD Data Services Full timeData Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Data Platform Engineer
4 days ago
India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Azure Data Engineering Expert
5 days ago
India NeerInfo Solutions Full timeJob Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at NeerInfo Solutions.About the Role:Proficiency in Azure services: The ideal candidate will have hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake.Programming skills: Strong proficiency in programming...
-
Cloud Data Engineering Lead
1 week ago
India ITI Data Full timeITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...