Lead PySpark Developer
6 days ago
Position Name : Lead PySpark Developer
Experience : 10 - 16 yrs
Location : Pan India
Budget : 46 LPA max including variables
Notice Period : Immediate to Serving NP (30 Days max remaining)
Job Description :
Primary Skill : Lead PySpark Skill : SAS tools
- Lead a team of data engineers in the design and implementation of big data solutions using PySpark.
- Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.
- Design and implement scalable and robust data pipelines using PySpark.
- Ensure data accuracy and integrity by implementing data validation and quality checks.
- Mentor and coach team members in PySpark and big data best practices.
- Stay up-to-date with the latest developments in big data technologies and incorporate them into the team's workflow.
Requirements :
- 9+ years in PySpark/ Data engineer development and implementation
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience as a PySpark Lead or similar role.
- Expertise in PySpark and big data technologies such as Hadoop, Hive, and Spark.'
Skills : Hadoop, Spark, Spark SQL - Scala
(ref:hirist.tech)
-
Senior PySpark Developer
3 days ago
Anywhere in India/Multiple Locations MWIDM Staffing Services Full timeAbout Our CompanyMWIDM Staffing Services is a leading provider of staffing solutions, specializing in placing top talent in data engineering roles.Job Overview:We are seeking an experienced Senior PySpark Developer to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining efficient and reliable data...
-
Lead Databricks/PySpark Developer
2 weeks ago
Anywhere in India/Multiple Locations Deltaclass Technology Solutions Pvt. Ltd. Full timeRequired Skills :Job Summary : Looking for an offshore Lead Databricks/PySpark Developer who is willing to learn new technologies if needed and able to work with team. This position is long term and will likely be renewed annually.Essential Job Functions- Design and development of data ingestion pipelines (Databricks background preferred).- Performance tune...
-
Senior PySpark Solutions Architect
6 days ago
Anywhere in India/Multiple Locations AJ Consulting Full timeCompany OverviewAJ Consulting is a leading consulting firm that specializes in delivering innovative data solutions to its clients. Our team of experts has extensive experience in designing and implementing big data solutions using PySpark.We are seeking a highly skilled Senior PySpark Solutions Architect to lead our big data engineering efforts and drive...
-
Lead Big Data Engineer
6 days ago
Anywhere in India/Multiple Locations AJ Consulting Full timeAbout the RoleThe Lead Big Data Engineer - AI Consulting will be responsible for leading a team of data engineers in the design and implementation of big data solutions using PySpark. This role requires expertise in PySpark, Hadoop, Hive, and Spark, as well as strong leadership and collaboration skills.You will work closely with cross-functional teams to...
-
Lead PySpark Developer
4 weeks ago
india AJ Consulting Full timePosition Name : Lead PySpark DeveloperExperience : 10 - 16 yrs Location : Pan IndiaBudget : 46 LPA max including variablesNotice Period : Immediate to Serving NP (30 Days max remaining)Job Description :Primary Skill : Lead PySpark Skill : SAS tools - Lead a team of data engineers in the design and implementation of big data solutions using PySpark. -...
-
Cymetrix Software
3 weeks ago
Anywhere in India/Multiple Locations CYMETRIX INFOTECH PRIVATE LIMITED Full timeJob Type : RemoteOpenings - 3 (Currently we have 3 AWS Data Engineer positions) : - AWS Data Engineer + 1 year of exp in Tableau - AWD Data Engineer + Rest API exp - AWS Data Engineer + Talend - 3yr in AWS and in Redshift, lambda, glue, S3, EMR, Athena. Programming skills : Python, Pyspark, Scala, ETL pipeline exp ( 2+ years in Python and Pyspark)Primary...
-
Big Data Solutions Lead
5 days ago
Anywhere in India/Multiple Locations AJ Consulting Full timeJob DescriptionWe are looking for a highly experienced Big Data Solutions Lead to join our team at AJ Consulting. In this role, you will be responsible for designing and implementing scalable and robust data pipelines using PySpark.You will also ensure data accuracy and integrity by implementing data validation and quality checks, and mentor and coach team...
-
Pyspark Developer
4 weeks ago
india Tata Consultancy Services Full timeGreetings from TCS!!TCS is hiring forPyspark DeveloperRequired Skill Set:Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range:4 to 10 YearsJob Location:Chennai / Pune / Bangalore / Hyderabad / Trivandrum / KochiMust Have:Data Engineer, Python developer with...
-
PySpark Developer
5 days ago
India Victrix Inc. Full timeJob DescriptionSenior PySpark Developer - Complex XML Data ProcessingKey Responsibilities- Design and develop scalable PySpark pipelines to ingest, parse, and process XML datasets with extreme hierarchical complexity.- Implement efficient XPath expressions, recursive parsing techniques, and custom schema definitions to extract data from nested XML...
-
Lead Databricks/PySpark Developer
4 weeks ago
India Deltaclass Technology Solutions Pvt. Ltd. Full timeRequired Skills :Job Summary : Looking for an offshore Lead Databricks/PySpark Developer who is willing to learn new technologies if needed and able to work with team. This position is long term and will likely be renewed annually.Essential Job Functions- Design and development of data ingestion pipelines (Databricks background preferred).- Performance tune...
-
Data Engineer Specialist
3 days ago
Anywhere in India/Multiple Locations MWIDM Staffing Services Full timeAbout MWIDM Staffing ServicesWe are a leading provider of staffing services, specializing in placing talented professionals in top data engineering roles.Job Description:The ideal candidate will have 5+ years of experience in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing...
-
Pyspark Developer
4 weeks ago
india Tata Consultancy Services Full timeGreetings from TATA CONSULTANCY SERVICES LIMITED !!!Role– Pyspark DeveloperExperience Range- 5 to 10 yearsWork Location – Hyderabad, PuneSKILLS REQUIRED:Analyze existing Teradata tables and Data Warehouse structures.Design and implement a strategy to migrate data from Teradata to Spark 3.x and Delta Lake.Develop PySpark scripts to extract, transform, and...
-
Enterprise Data Pipeline Architect
3 days ago
Anywhere in India/Multiple Locations MWIDM Staffing Services Full timeAbout the RoleWe are seeking an Enterprise Data Pipeline Architect to join our team at MWIDM Staffing Services. The ideal candidate will have a strong background in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing ETL processes to ingest, transform, and load data from...
-
Data Engineer
3 days ago
Anywhere in India/Multiple Locations MWIDM Staffing Services Full timeResponsibilities :- Design, develop, and maintain efficient and reliable data pipelines using PySpark.- Implement ETL processes to ingest, transform, and load data from various sources.- Optimize PySpark code for performance and scalability.- Work with large datasets and distributed computing frameworks.- Develop and maintain data quality checks and...
-
TQuanta Technologies
3 weeks ago
Anywhere in India/Multiple Locations TQuanta Technologies Pvt. Ltd. Full timeJob Description : PySpark Developer Position Overview :We are seeking a highly skilled PySpark Developer with experience to join our dynamic team. The ideal candidate will have a strong background in big data technologies, with expertise in PySpark and related tools to design, develop, and maintain scalable data processing solutions. This role involves...
-
Lead Databricks/PySpark Developer
4 weeks ago
delhi, in C2E Consultancy Full timeJob Summary : Looking for an offshore Lead Databricks/PySpark Developer who is willing to learn new technologies if needed and able to work with team. This position is long term and will likely be renewed annually.Job Title : DeveloperEssential Job Functions : - Design and development of data ingestion pipelines (Databricks background preferred). -...
-
Lead Developer
1 week ago
Anywhere in India/Multiple Locations Burgeon It Services Pvt Ltd Full timeJob Title : Lead React DeveloperLocation : Pan IndiaExperience : 6+ YearsJob Description :We are seeking an experienced Lead React Developer to join our dynamic team. As a Lead Developer, you will play a pivotal role in designing and implementing user interfaces for our web applications. You will lead a team of developers, ensuring best practices and coding...
-
Big Data Engineer
1 week ago
Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full timeResponsibilities :- Design, develop, and implement robust big data pipelines and ETL processes using Hadoop and PySpark.- Perform data analysis, transformation, and cleansing to extract valuable insights.- Optimize performance and scalability of big data applications.- Collaborate with data scientists and analysts to understand data requirements and...
-
Lead Databricks/PySpark Developer
4 weeks ago
india Deltaclass Technology Solutions Pvt. Ltd. Full timeRequired Skills :Job Summary : Looking for an offshore Lead Databricks/PySpark Developer who is willing to learn new technologies if needed and able to work with team. This position is long term and will likely be renewed annually.Essential Job Functions- Design and development of data ingestion pipelines (Databricks background preferred).- Performance tune...
-
Cymetrix Software
7 days ago
Anywhere in India/Multiple Locations CYMETRIX INFOTECH PRIVATE LIMITED Full timeJob Description : - 3yr in AWS and in Redshift, lambda, glue, S3, EMR, Athena.Programming skills : Python, Pyspark, Scala, ETL pipeline exp ( 2+ years in Python and Pyspark)- 1+ years experience in Tableau and REST API- 3+ Years of Experience with AWS Data services like S3, Glue, Lake Formation, EMR, Kinesis, RDS,DMS and Redshift - Design and develop data...