Pyspark with Scala

Job Description:In the role of Data Engineer you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation Application Architecture definition and DesignYou will play an important role in creating the high level design artifactsYou will also...

Job Description:Azure Spark PySpark ScalaAzure SynapseAzure knowledge mustKey Responsibilities:Engage with Business Stakeholders with status update on progress of development and issue fixSetup Standards related to Coding Pipelines and DocumentationUnderstand the requirements from the business and translate it into an appropriate technical requirementDefine...

Mandatory Key skills: Primary skill required for the data engineer role is hands-on experience withSpark, particularly PySpark. Candidates must have experience in coding data pipelines in Spark andshould be comfortable with Python for automation. Other skills like Azure, Airflow, and Databricks are good to have but notmandatory. 1 Coding...

DescriptionAbout KPMG in IndiaKPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, regulations, markets and competition. KPMG has offices...

,.Job Description: We are looking for an experienced Data Engineer with strong expertise in data pipeline development, cloud-based data processing, and analytics solutions. The ideal candidate should have hands-on experience working with AWS data services and be proficient in programming and data integration tools.Key Responsibilities:Design, develop, and...

Role & responsibilitiesDevelop and maintain data pipelines using AWS Glue, Lambda, EMR, and Snowflake.Implement real-time ingestion using Snowpipe and Streams for CDC (Change Data Capture).Write efficient PySpark or Scala Spark jobs for large-scale data processing.Automate workflows and orchestrate jobs using AWS Step Functions, Airflow, or similar...

Mandatory Skills - AWS , PySpark, Databricks, , Terraform, AngularDesired Skills - ETL, Python, SQLExperience - 3 years - 5 yearsLocation - Pune / Mumbai / Chennai / BangaloreStrong experience in Python, PySpark, and SQL Angular for front-end developmentExperience with AWS services (S3, CloudWatch, IAM, SNS, Lambda) Terraform knowledgeExperience with Git,...

DescriptionJob Summary :We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines using Snowflake, AWS services, and Apache Spark. You will be responsible for real-time and batch data ingestion, transformation, and orchestration across cloud platforms.Notice Period - 0 to 15 days.Key ResponsibilitiesDevelop and...

Skill:Data EngineerNotice Period:Immediate.Employment Type: ContractJob Description:Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, ScalaPerformance Turing Optimize SQL, PySpark for performanceAirflow workflow scheduling tool for creating data pipelinesGitHub source...

ResponsibilitiesBuild and maintain scalable data platforms and pipelines.Develop data products like recommendations and customer insights.Design and manage Feature Store for analytics and model training.Preferred candidate profileExperience in Big Data, PySpark, Python/Scala.Strong in data modeling, architecture, and analytics.Experience with Spark,...