Senior Data Engineer- PySpark

Primary_skills(Must_have)Key Responsibilities :Advanced PySpark Development:Write Efficient PySpark Code: Develop high-quality, reusable, and scalable PySpark scripts to process large datasets.Custom Transformations: Design and implement custom transformations and user-defined functions (UDFs) to meet specific data processing requirements.Data Frame...

Primary_skills(Must_have) Key Responsibilities : Advanced PySpark Development: Write Efficient PySpark Code: Develop high-quality, reusable, and scalable PySpark scripts to process large datasets. Custom Transformations: Design and implement custom transformations and user-defined functions (UDFs) to meet specific data processing requirements. Data Frame...

Primary_skills(Must_have) Key Responsibilities : Advanced PySpark Development: Write Efficient PySpark Code: Develop high-quality, reusable, and scalable PySpark scripts to process large datasets. Custom Transformations: Design and implement custom transformations and user-defined functions (UDFs) to meet specific data processing requirements. Data Frame...

Technical/Functional Skills (Mandatory skills):* 5+ years of experience in programming with python. Strong proficiency in python* Familiarity with functional programming concepts* 3+ years of hands-on experience in developing ETL data pipelines using pySpark on AWS EMR* Good understanding of Spark’s Dataframe and API* Experience in configuring EMR clusters...

Job Overview :We are looking for a skilled Azure Data Engineer to design, develop, and optimize data pipelines and solutions within the Azure ecosystem. The ideal candidate will possess expertise in Azure Databricks, Azure Data Factory, Azure Cloud services, and have strong proficiency in Data Modelling, SQL, and PySpark.Key Responsibilities :- Design and...

Data EngineerJob Title : Data EngineerAbout the Role :- This role involves designing, developing, and maintaining data pipelines and solutions within an AWS environment.- The ideal candidate will have strong expertise in ETL processes, data warehousing, and big data technologies.Key Responsibilities :- Develop and maintain ETL pipelines using AWS services...

Project Role: Sr Data EngineerWork Experience: 8 to 13 YearsWork location: BengaluruWork Mode: HybridMust Have Skills: Pyspark, Azure Databricks, Azure Datalake Job Responsibilities:Analyze highly complex business requirements.Generate technical specifications to design.Redesign complex software components and applications.Act as an expert technical resource...

Position Name : Data Architect. Experienced Range : 10 to 18 Years. Location : Greater Noida, Gurugram, Pune, Kolkata, Hyderabad, and BangaloreMandatory Skills Databricks, Py-Spark, Amazon Web Services(AWS). Job Description :- Expertise in designing, implementing, and maintaining data solutions including delta lake, data warehouse, data marts and data...

Greetings from TCS!! TCS is hiring for Pyspark Developer Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Desired Experience Range: 4 to 10 Years Job Location: Chennai / Pune / Bangalore / Hyderabad / Trivandrum / Kochi Must Have: Data Engineer, Python...

Greetings from TCS!! TCS is hiring for Pyspark Developer Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Desired Experience Range: 4 to 10 Years Job Location: Chennai / Pune / Bangalore / Hyderabad / Trivandrum / Kochi Must Have: Data Engineer, Python...

Position : Senior Data ScientistExperience : 6 yearsRequired Skills : - TensorFlow- PyTorch- Pandas- AI/ML- Python- MLops- PySpark- AzureKey Responsibilities : Data Analysis & Modeling : Apply advanced statistical methods, machine learning algorithms, and predictive modeling techniques to solve complex business problems.Collaborate with Teams : Work closely...

What You'll Be Doing :- Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 100s of terabytes of data ingested every day and petabyte-sized data warehouse and elasticsearch cluster.- Build quality data solutions and refine existing diverse datasets to simplified models...

Role : AWS Data Engineer / AWS Service DeveloperLocation : Bangalore, ChennaiYears of experience : 2 to 10 yearsRole : Software Engineer / Senior Software Engineer / Lead AnalystKey skills : AWS Developer, AWS Data Engineer, AWS API Gateway, AWS RDS, AWS network, AWS Glue, AWS Lambda. We are seeking a highly skilled AWS Developer with 2 -10 years of hands-on...

Job Overview : We are looking for a skilled Azure Data Engineer to design, develop, and optimize data pipelines and solutions within the Azure ecosystem. The ideal candidate will possess expertise in Azure Databricks, Azure Data Factory, Azure Cloud services, and have strong proficiency in Data Modelling, SQL, and PySpark.Key Responsibilities : - Design...

About Freo : Freo is a credit-led neobank that is looking to build an innovative digital banking experience that focuses on the unique needs of modern consumers in India and SE Asia with a host of financial products such as a digital savings account, uber-flexible credit line, credit, and EMI cards, buy now pay later (BNPL) schemes - all in one place.Freedom...

Job Description – Senior Data Engineer (6+ Years, PySpark & AWS)Experience required- 6 to 10 yearsWe are seeking aSenior Data Engineerwith6+ years of experienceinbig data processing and real-time streaming . The ideal candidate will have strong expertise inPySpark ,Apache Spark , andAWS-based data pipelines , with hands-on experience inreal-time streaming...

Job Description – Senior Data Engineer (6+ Years, PySpark & AWS)Experience required- 6 to 10 yearsWe are seeking aSenior Data Engineerwith6+ years of experienceinbig data processing and real-time streaming . The ideal candidate will have strong expertise inPySpark ,Apache Spark , andAWS-based data pipelines , with hands-on experience inreal-time streaming...

Job Description – Senior Data Engineer (6+ Years, PySpark & AWS) Experience required- 6 to 10 years We are seeking a Senior Data Engineer with 6+ years of experience in big data processing and real-time streaming . The ideal candidate will have strong expertise in PySpark , Apache Spark , and AWS-based data pipelines , with hands-on experience in...

Job Description – Senior Data Engineer (6+ Years, PySpark & AWS)Experience required- 6 to 10 yearsWe are seeking a Senior Data Engineer with 6+ years of experience in big data processing and real-time streaming. The ideal candidate will have strong expertise in PySpark, Apache Spark, and AWS-based data pipelines, with hands-on experience in real-time...

Job Description – Senior Data Engineer (6+ Years, PySpark & AWS) Experience required- 6 to 10 years We are seeking a Senior Data Engineer with 6+ years of experience in big data processing and real-time streaming . The ideal candidate will have strong expertise in PySpark , Apache Spark , and AWS-based data pipelines , with hands-on experience in...