Pyspark Data Engineer
22 hours ago
Role: Data Engineer with Mandatory Pyspark Knowledge
Required Technical Skill Set: Python , Pyspark, BigQuery
Desired Experience Range: 5+ yrs
Desired Experience: 0-60 Days
Location: Bangalore, Pune, Chennai, Gurugram
Desired Competencies (Technical/Behavioral Competency)
- Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based applications.
- Resource should have experience in Astronomer DAGS, Python, Pyspark, GCP, BigQuery.
- Collaborate with cross-functional teams including designers, product owners, managers, and stakeholders.
- Execute the unit testing to produce defect-free software.
- Ensuring test coverage and creating test methods.
- Creating documentation on modules/enhancements developed.
- Experience on
Airflow
,
Python
coding,
BigQuery
concepts. - Functional knowledge of billing automations.
- Ensure high quality code standards, security, & performance optimization.
- Agile Methodology and prior experience of implementation with Agile way of working.
- Stay with current trends and new technologies.
Kindly attach your updated resumes for screening
Thanks & Regards
Snigdha Samaptika
BFSI TAG Team
-
Oracle + PySpark Data Engineer
3 days ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Description: Experiance:5 to 7 YearsWe are seeking a highly skilled and motivated Oracle + PySpark Data Engineer/Analyst to join our team. The ideal candidate will be responsible for leveraging the Oracle database and PySpark to manage, transform, and analyze data to support our business's decision-making processes. This role will play a crucial part...
-
Senior Data Engineer
3 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 30,00,000 per yearBuild scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...
-
Sr. Snowflake Data Engineer Pyspark
2 weeks ago
Bengaluru, Karnataka, India EduRun Group Full time ₹ 20,00,000 - ₹ 25,00,000 per yearSenior Data Engineer | 10-12 Years Experience | Must Have: Proven expertise in building scalable batch and streaming data pipelines using Databricks (PySpark) and Snowflake.Lead the design, implementation, and optimization of application data stores using PostgreSQL, DynamoDB, and advanced SQL.Strong programming skills in SQL, Python, and PySpark for...
-
Data Engineer, Pyspark
2 weeks ago
Bengaluru, Karnataka, India NatWest Group Full time ₹ 1,50,00,000 - ₹ 2,50,00,000 per yearJoin us as a Data EngineerWe're looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secureDay-to-day, you'll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insightsIf you're...
-
Data Engineer
6 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per yearReq ID: 345819NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Role:...
-
Python Pyspark
2 days ago
Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 15,00,000 per yearGreetings from Tata Consultancy Services (TCS)Location : Chennai, Bangalore, Pune, DelhiExperience : 5-10 YearsRole: Python Pyspark DeveloperRequired Skill set Python, Pyspark, Scala, SparkMust HaveStrong analytical skills in conducting sophisticated statistical analysis using bureau/vendor data, customer performances.Working experience in languages PySpark...
-
Data Engineer with SQL/ETL/Pyspark
7 days ago
Bengaluru, Karnataka, India Infosys Finacle Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMandate Skills - SQL, ETL ,hadoop, pyspark, Apache, KafkaRequired Skills5+ years of relevant Data engineering experience using Python or Java as tech be well versed into HadoopDevelopment expertise with 2+ years of experience, in SQL, ETL processes and other similar technologiesSkilled in Identifying and optimizing database queriesStrong understanding of...
-
Pyspark developer
4 days ago
Bengaluru, Karnataka, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description:In the role of Data Engineer you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation Application Architecture definition and DesignYou will play an important role in creating the high level design artifactsYou will also...
-
Data & AI Engineer Lead
4 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearFramework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...
-
Senior Data Engineer
3 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 14,00,000 per yearReq ID: 345817NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....