Pyspark

Type: Contract-to-Hire (C2H)Job SummaryWe are looking for a skilled PySpark Developer with hands-on experience in building scalable data pipelines and processing large datasets. The ideal candidate will have deep expertise in Apache Spark, Python, and working with modern data engineering tools in cloud environments such as AWS. Key Skills &...

Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...

Role Overview: As a member of the Classical ML+NLP+Gen AI - L4 team at Tredence, you will be involved in tasks such as Model Fine-tuning, Model Pre-training, Named Entity Recognition, Prompt Engineering, Pyspark, Python, Regular expressions, SQL, Supervised ML, Tokenization, Transformer Models, Transformers, Unstructured Data Pre-processing, and Unsupervised...

•Exp of unified data platform,Data lifecycle starting from Data Ingestion, Transformation, Serve and consumption.• Must have excellent coding skills in Pyspark,Spark sql.• Must be strong in SQL and sprak-sql.Expin Data Engineering domain.•

Skill: AWS GlueExperience: 6 to 9 yearsLocation: KolkataJob descriptionTechnical Skills :AWS Glue: 3+ years of hands-on experience in AWS Glue ETL developmentPython/PySpark: Strong programming skills in Python and PySpark for data transformationAWS Services: Proficiency in S3, Redshift, Athena, Lambda, and EMRData Formats: Experience with Parquet, Avro,...

Role & responsibilities• Develop and maintain scalable data pipelines using Apache Spark on Databricks.• Build end-to-end ETL/ELT pipelines on AWS using services like S3, Glue, Lambda, EMR, and Step Functions.• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.• Design and implement data...

Location: Pune/kolkata Skillset we are looking for: 6+ experience with Cloud technologies, especially AWS services (S3, Athena, Glue, DynamoDB, Step Functions, etc). Strong understanding of Redshift, EMR, Athena, Aurora, Kinesis, Lambda, EC2, Python etc. Must have Technical strength in SQL, Cloud Technologies, ETL development and data warehousing.. Ensure...

Role & responsibilities :Design, Develop and Test data ingestion/ETL pipelines with S3 Storage, Postgres, Athena, Redshift.Strong experience in Python, Pyspark, SQL, Glue, Lambda and orchestration techniquesDevelops stored procedures, database triggers and SQL queries with an understanding of data warehousing objects (type-2 dimensions, CDC, aggregations,...

Job Title: Databricks Data EngineerLocation:Kolkata, India (On-site)Experience:3–8 YearsNotice Period:Immediate Joiners PreferredJob Summary:We are looking for a skilledDatabricks Data Engineerwith hands-on experience inPySparkandSQLto join our data engineering team in Kolkata. The ideal candidate will design, develop, and maintain scalable data pipelines...

About the role :We are looking for a Data Engineer with strong Databricks expertise to join our team. This role will be pivotal in building robust ingestion pipelines, creating curated data views, and normalizing legacy datasets from sources like SharePoint, Excel, and other business systems. The ideal candidate will bring hands-on technical skills along...