Senior Big Data Engineer
1 week ago
Position - Senior Big Data Engineer (GCP)
Experience - 5 to 8 Years
Location - Remote
Shift Time - EST Shift (5:30 PM to 2:30 AM)
Position Overview :
- We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery.
The successful candidate will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics.
This role requires excellent data analysis skills and the ability to architect solutions for cloud-based environments, with a focus on extracting, processing, and analyzing data from diverse sources.
Key Responsibilities :
- Design, develop, and optimize Big Data pipelines and workflows using Hadoop, Hive, PySpark,and Google BigQuery.
- Architect data solutions to facilitate smooth data migration and processing between on premises systems and Google Cloud Platform (GCP).
- Create and manage Unix Shell Scripts for process automation and data handling tasks.
- Perform in-depth data analysis and work comfortably with large datasets to derive actionable insights.
- Collaborate effectively with cross-functional teams to understand data requirements and translate them into scalable data solutions.
- Ensure data quality, integrity, and security across all stages of the data lifecycle.
- Stay updated with the latest industry trends and emerging technologies to continuously improve data solutions.
Mandatory Qualifications :
- Minimum of 8 years of industry experience working with Big Data technologies.
- Proficiency in Hadoop, Hive, and PySpark for data processing.
- Strong experience with Unix Shell Scripting.
- Expertise in SQL and extracting data from multiple sources.
- Demonstrated experience in data analysis, specifically querying and analyzing large datasets on
- Hadoop HDFS using Hive and Spark.
- Proven experience in architecting Big Data pipelines and data solutions.
- Proficiency in Google BigQuery and migrating data pipelines to GCP.
- Exceptional communication skills for clear requirement gathering and collaboration.
Preferred Qualifications :
- Google Cloud Platform (GCP) certification.
- Professional experience with cloud hosting platforms, with a preference for GCP.
-
Senior big data sme
8 hours ago
Delhi, Delhi, India Information Tech Consultants Full timeUrgent Hiring Senior Big Data Engineer, 10+ yrs of experience. REMOTE JOBJob Title: Senior Big Data SME (Subject Matter Expert)Location: RemoteWork Hours: UK Time (1:30 PM – 10:30 PM IST)Industry: Technology / ITExperience: 10+ years in Data Engineering, Big Data, or related rolesCompensation: Open to discussAbout the RoleWe are hiring a Senior...
-
Senior big data sme
3 days ago
Delhi, Delhi, India Information Tech Consultants Full timeJob Title: Senior Big Data SME (Subject Matter Expert)Location : "REMOTE"Company/Industry : Technology/ ITTime : UK Time (1:30pm - 10:30pm IST)Budget : OpenExperience : 8-10+ years in Data Engineering or related roles, with a focus on cloud technologies and big data solutions.Job Description:We are seeking a Senior Big Data Subject Matter Expert (SME) to...
-
Senior Big Data Sme
3 days ago
Delhi, Delhi, India Information Tech Consultants Full timeJob Title: Senior Big Data SME (Subject Matter Expert)Location : "REMOTE"Company/Industry : Technology/ ITTime : UK Time (1:30pm - 10:30pm IST)Budget : OpenExperience : 8-10+ years in Data Engineering or related roles, with a focus on cloud technologies and big data solutions.Job Description:We are seeking a Senior Big Data Subject Matter Expert (SME) to...
-
Senior Big Data Architect
2 hours ago
Delhi, Delhi, India Information Tech Consultants Full timeWe are Information Tech Consultants, a technology company seeking an experienced Senior Big Data SME to join our team.About the CompanyInformation Tech Consultants is a leading provider of technology services, with a focus on cloud data solutions. We are seeking an experienced Senior Big Data SME to join our team, who will be responsible for providing...
-
Big Data Engineer
3 weeks ago
Delhi, Delhi, India Easy Recruit Global Full timeJob Description :- Strong proficiency in data engineering techniques, including ETL processes, data modeling, and database design.- In-depth knowledge of big data technologies like Apache Spark, Hadoop, and cloud services such as AWS, Azure, or GCP.- Strong problem-solving and troubleshooting skills to identify and resolve performance issues within data...
-
Big Data Engineer
2 weeks ago
Delhi, Delhi, India Easy Recruit Global Full timeJob Description :- Strong proficiency in data engineering techniques, including ETL processes, data modeling, and database design.- In-depth knowledge of big data technologies like Apache Spark, Hadoop, and cloud services such as AWS, Azure, or GCP.- Strong problem-solving and troubleshooting skills to identify and resolve performance issues within data...
-
Big Data Architect Specialist
2 days ago
Delhi, Delhi, India Information Tech Consultants Full timeJob Title:Senior Big Data Subject Matter Expert (SME)Company Overview:Information Tech Consultants is a leading technology firm that specializes in providing cutting-edge solutions for big data and cloud computing. We are seeking an experienced Senior Big Data Subject Matter Expert to join our team.Job Description:We are looking for a skilled professional to...
-
Big Data Engineer
4 days ago
Delhi, Delhi, India Unlock Business Consulting Full timeAbout the JobWe are looking for a skilled Big Data Engineer to join our team at Unlock Business Consulting. As a Big Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that enable our organization to process, analyze, and derive insights from massive datasets.Key ResponsibilitiesDesign, develop, and...
-
Data Insights Specialist
1 day ago
Delhi, Delhi, India Big Data Trunk Full timeCompany Overview">At Big Data Trunk, we are dedicated to harnessing the power of data to drive business success. Our team is passionate about working with clients to uncover insights and make informed decisions.">Job Description">We are seeking a highly motivated Data Discovery Analyst to join our team. As a key member of our business intelligence team, you...
-
Senior Big Data Engineer
3 days ago
Delhi, Delhi, India MWIDM Staffing Services Full timeAbout the Role:MWIDM Staffing Services is seeking a skilled Python Developer to join our team and contribute to building a Python-based code generation framework and runtime engine that interacts with a Business Rules repository.Key Responsibilities:Design and develop a Python-based code generation framework and runtime engine.Work with large-scale Big Data...
-
Sr. big data sme
8 hours ago
Delhi, Delhi, India Tech Consulting Full timeJob Title: Senior Big Data SME (Subject Matter Expert) Location: RemoteWork Hours: UK Time (1:30 PM – 10:30 PM IST)Industry: Technology / ITExperience: 10+ years in Data Engineering, Big Data, or related rolesCompensation: 28 LPAAbout the RoleWe are hiring a Senior Big Data Subject Matter Expert (SME) to support and guide ongoing cloud data...
-
Big Data Engineer
2 hours ago
Delhi, Delhi, India Talent Corner HR Services Pvt Ltd Full timeJob OverviewWe are looking for an experienced Big Data Engineer to join our team at Talent Corner HR Services Pvt Ltd. The successful candidate will design, build, and maintain large-scale data systems to support business growth and decision-making.Key Responsibilities:Design and implement efficient data architectures and models for big data...
-
Sr. big data sme
3 days ago
Delhi, Delhi, India Tech Consulting Full timeJob Title: Senior Big Data SME (Subject Matter Expert)Location: RemoteAbout Us: We are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem (Azure, AWS, GCP). As part of an exciting growth phase, we are looking for a Senior Big Data SME to join our team. This role will allow you to leverage your expertise in...
-
Senior Software Engineer
2 hours ago
Delhi, Delhi, India Luxoft Full timeAbout Us: Luxoft is a leading player in the financial services industry, providing cutting-edge solutions to top investment banks. Our Liquidity Risk platform helps our clients reduce operational risk and increase efficiency. As a Senior Big Data Developer, you will play a critical role in driving innovation and excellence within our team.
-
Big Data Technical Lead
2 hours ago
Delhi, Delhi, India Information Tech Consultants Full timeWe are Information Tech Consultants, a technology firm seeking an experienced Senior Big Data SME to lead our cloud data initiatives.Job DescriptionThe ideal candidate will have deep technical experience in Big Data platforms, including Azure, AWS, and GCP. They will provide technical support and guidance across these platforms, as well as train and mentor...
-
Big Data Technology Lead
3 days ago
Delhi, Delhi, India Tech Consulting Full timeUnlock Data PotentialWe are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem. As part of an exciting growth phase, we are looking for a Senior Big Data SME to join our team.This role will allow you to leverage your expertise in cloud technologies, big data, and data engineering to drive innovation and...
-
Delhi, Delhi, India Smartavya Analytica Full timeAt Smartavya Analytica Private Limited, we are pioneers in data-driven innovation and transform enterprise data into strategic insights.We are seeking an experienced Data Engineering Leader to lead our end-to-end architecture, design, and implementation of Hadoop-based Cloudera CDP on-prem data solutions.The ideal candidate will have extensive proficiency in...
-
Big Data Engineer
4 weeks ago
Delhi, Delhi, India Findem Full timeWhat is Findem : Findem is the only talent data platform that combines 3D data with AI. It automates and consolidates top-of-funnel activities across your entire talent ecosystem, bringing together sourcing, CRM, and analytics into one place. Only 3D data connects people and company data over time - making an individual's entire career instantly accessible...
-
Big Data Engineer
3 weeks ago
Delhi, Delhi, India Findem Full timeWhat is Findem : Findem is the only talent data platform that combines 3D data with AI. It automates and consolidates top-of-funnel activities across your entire talent ecosystem, bringing together sourcing, CRM, and analytics into one place. Only 3D data connects people and company data over time - making an individual's entire career instantly accessible...
-
Big Data Engineer
3 weeks ago
Delhi, Delhi, India Findem Full timeWhat is Findem : Findem is the only talent data platform that combines 3D data with AI. It automates and consolidates top-of-funnel activities across your entire talent ecosystem, bringing together sourcing, CRM, and analytics into one place. Only 3D data connects people and company data over time making an individual's entire career instantly accessible in...