
Pyspark Developer
4 days ago
Day-to-Day Activities:Design, develop, and maintain ETL pipelines using PySpark on CDP.Implement and manage data ingestion processes from various sources. Process, cleanse, and transform large datasets using PySpark. Conduct performance tuning and optimization of ETL processes.
Implement data quality checks and validation routines. Automate data workflows using orchestration tools. Monitor pipeline performance and troubleshoot issues.
Collaborate with team members to understand data requirements. Maintain documentation of data engineering processes and configurations. Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.
Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Sigma Allied Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearPosition - Pyspark DeveloperLocation - BangaloreExperience - 6 to 9 yrsRequired Skills -Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.Must have skills : PySparkMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary:As an...
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Unified Excellence Full time US$ 90,000 - US$ 1,20,000 per yearResponsibilities:* Collaborate with cross-functional teams on project delivery.* Ensure code quality through testing and documentation.* Design, develop, and maintain PySpark applications using Python and Spark.
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Nuvento Systems Full time ₹ 6,00,000 - ₹ 12,00,000 per yearWe are looking for immediate joiner | Work from HomeKey skills:Pyspark, Apache Spark, AWS, Databricks, Scala, Java
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India EduRun Group Full time US$ 90,000 - US$ 1,20,000 per year5+ years of hands-on experience in developing and optimizing large-scale data pipelines using PySpark.Strong expertise in ETL workflows, data cleansing, and transformations to enable analytics and machine learning use cases.Proficient in big data technologies such as Hadoop, Hive, HDFS, and Spark SQL .Ability to collaborate with cross-functional teams to...
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Naukri E Hire Campaign Full time US$ 90,000 - US$ 1,20,000 per yearCompany Name: NatWest GroupExperience: 7-11 YearsLocation: Bangalore (Hybrid Model)Interview Mode: VirtualInterview date: 23rd August (Saturday)Interview Rounds: 2 RoundsNotice Period: AnyJob description:Experience in PySpark AWS, and SQLStrong experience in Airflow, CI/CD, and DevOpsExperience of DevOps and Agile methodology and associated toolsets...
-
Pyspark
7 days ago
Bengaluru, Karnataka, India Virtusa Full time ₹ 1,04,000 - ₹ 1,30,878 per yearhighly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...
-
Big Data/Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 1,04,000 - ₹ 1,30,878 per yearSenior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...
-
Snowflake+Pyspark developer
5 days ago
Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,000 - ₹ 28,00,000 per yearSnowflake+Pyspark developer ||4 Years||Pan IndiaUnderstanding of data modeling concepts, data warehousing tools and databases • Experience in Snowflake, SQL, Cloud (AWS) , Unix Technologies experience • Must have hands on experience on SQL , Snowflake • Experience in AWS S3 and other common aws services. • Should have experience working with multiple...
-
Data Engineer- PySpark
1 week ago
Bengaluru, Karnataka, India Valuelabs Full time US$ 90,000 - US$ 1,20,000 per yearJob Title- PySpark Data EngineerWe're growing our Data Engineering team at ValueLabs and looking for a talented individual to build scalable data pipelines on Cloudera Data PlatformExperience- 5years to 9years.Pyspark Job Description:Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the...
-
Spark ( Pyspark ) Developer
4 weeks ago
Bengaluru, Karnataka, India Phygital Insights Full timeJob Description- The developer must have sound knowledge in Apache Spark and Python programming.- Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.- Experience in deployment and operationalizing the code is added advantage...