Pyspark Dsa 4 to 8 Years Pan India

2 months ago


Bengaluru Karnataka, India Capgemini Full time

**Job Description**:

- Bachelor’s or master’s degree in computer science, Engineering, or related field
- 5-8 years of experience in data engineering and machine learning
- Extensive experience with Python programming, including Pandas, NumPy, and various libraries for data manipulation and analysis
- Hands-on experience with Spark architecture, including data frame operations, lazy evaluation, and UDFs
- Strong understanding of DevOps principles and experience with tools like Docker, Kubernetes, and Jenkins
- Familiarity with machine learning libraries such as Spark ML-lib or Azure ML is a plus
- Previous experience in product-oriented organizations or Tier 1 companies is preferred

**Primary Skills**:

- Utilize advanced SQL techniques such as joins with in-line views and self-joins for data manipulation and extraction
- Proficient in Python programming, including but not limited to variables, functions, loops, conditions, and various data structures
- Implement object-oriented programming concepts including polymorphism, abstract classes, and interfaces for code modularity and reusability
- Develop and maintain data pipelines using Spark architecture, understanding nodes, clusters, lazy evaluation, and DAG in Spark
- Perform data frame operations and user-defined functions (UDFs) for efficient data processing in Spark
- Integrate APIs for data retrieval and interaction with external systems
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions

**Secondary Skills**:

- Good Communication Skills


  • Dsa Executives

    1 month ago


    Bengaluru, India RSD Loans Full time

    Become our DSA Partner! We are providing the Highest payout in the market for personal loans **Benefits**: - Full Payout every 7 Days for a Personal loan - Highest payout in the Industry - Digital, secured & Transparent Process - 60+banks & NBFC - 15+ Loan Products - Pan India Business **Job Types**: Full-time, Part-time, Regular / Permanent, Fresher,...


  • Bengaluru, India Capgemini Full time

    professional experience in database management, data solution development, data transformation, and data quality assurance. - Proficiency in using Palantir tools, including Code repository, Ontology manager, Object view, Workshop (dashboard, action Forms), and Data Connection. - Strong hands-on experience with Python and PySpark, demonstrating the ability to...


  • Bengaluru, India Capgemini Full time

    **Job Description**: - professional experience in database management, data solution development, data transformation, and data quality assurance. - Proficiency in using Palantir tools, including Code repository, Ontology manager, Object view, Workshop (dashboard, action Forms), and Data Connection. - Strong hands-on experience with Python and PySpark,...

  • Pyspark

    1 month ago


    Bengaluru, India Riverforest Connections Full time

    Position Purpose - For the projects which are implemented on Data SSC platform, we need senior developer for python - pyspark development to migrate project from spark/scala to python-pyspark._ **Responsibilities** **Direct Responsibilities** Design high quality deliverables adhering to business requirement with defined standards and design principles,...


  • Bengaluru, Karnataka, India Capgemini Full time

    **Job Description**: - **A minimum of 3 to 4 years of hands-on experience in SAP Global Trade Services GTS integration advisory and delivery.**: - **Experience in configuring and implementing one or more of the following SAP GTS Modules**: **1 Compliance Management SAP GTS Compliance** **2 Customs Management SAP GTS Customs** **3 Risk Management SAP GTS...

  • SAP ABAP

    1 month ago


    Bengaluru, Karnataka, India Zensar Technologies Full time

    Around 6+ years(relevant 5years) of SAP technical experience for Intermediate and 8+years for Senior Role - Minimum 4-5 years of hands-on Experience in SAP full stack - Strong experience in ABAP, OOABAP and Test-Driven Development - Strong experience in RICEF implementation, SAP gateway, ODATA, BRF+, ALE/IDOCs - Strong experience in S4HANA, HANA and concepts...


  • Bengaluru, India KreditBee Full time

    Roles and ResponsibilitiesDevelop DSA/Offline channels for sourcing Business loans: A target-oriented role workingwith the business teams for sourcing unsecured business loans via DSA/other offline channels.Activities and Tasks• Identify and engage with top tier DSA networks/offline channels for sourcing businessloans and scale these channels over a period...


  • Bengaluru, Karnataka, India Newton School Full time

    **ABOUT NEWTON SCHOOL** Come be part of a rocketship that’s creating a massive impact in the world of education! On one side you have over a million college graduates every year with barely 5% employability rates and on the other side, there are thousands of companies struggling to find talent. Newton School aims to bridge this massive gap through it’s...


  • Bengaluru, Karnataka, India Capgemini Full time

    **Job Description**: - 4-8 years of experience in Full stack with Angular, HTML, CSS, Java, Rest API, Spring and Spring boot - Good experience/knowledge in Microservices - CI/CD experience must have - Exposure to Cloud deployment activities **Primary Skills**: - 4-8 years of experience in Full stack with Angular, HTML, CSS, Java, Rest API, Spring and...

  • Python & Pyspark

    1 month ago


    Karnataka, India Teradata Full time

    Teradata’s Global Delivery Center (GDC) brings together data enthusiasts from all corners of the world to support our customers across the globe. We analyze their business needs and address them with the most sophisticated data solutions including Data Warehouses, Data Lakes, Operational Data Stores and much more. We deliver and manage complex hybrid...


  • Bengaluru, Karnataka, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** **Hiring Location** **Role** **Main skill** **Experience** - Kolkata, Bhubaneshwar, Pune, Mumbai, Bangalore- Developer- Informatica Powercentre- 4-6 yrs- CHN/MUM/HYD/BLR/AHMD- Developer- Datastage- 4 to 6-...

  • Pyspark Developer

    1 week ago


    Bengaluru, India Manvision Technologies Full time

    SNRequired InformationDetails1RolePySpark Developer2Required Technical Skill SetPySpark, Python, HDFS, Hadoop, SQL3No of Requirements024Desired Experience Range5+ yearsLocation of RequirementIndiaDesired Competencies (Technical/Behavioral Competency)Must-HaveSound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured &...


  • Bengaluru, Karnataka, India CGI Full time

    Position: Software Engineer/Senior Software Engiener (DevOps Engineer) Experience: 4 to 8 years Category: Software Development/ Engineering: Main location: India - Mumbai/Bangalore Position ID: J0524-1067 **Together, as owners, let’s turn meaningful insights into action.** Life at CGI is rooted in ownership, teamwork, respect and belonging. Here,...


  • Bengaluru, India Capgemini Invent Full time

    Require 8+ years’ experience in Data Strategy (Tech Architects, Senior BA’s) who will support our product, sales, leadership teams by creating data-strategy roadmaps. - Must have a proven ability to understand current data pipeline and ensure mínimal cost-based solution architecture is created. - Must be comfortable working with a wide range of...

  • Data Engineer

    1 month ago


    Bengaluru, India HNM Solutions Full time

    Note : Only immediate joinerRole : PysparkExperience : 8+ yearsLocation : Hyderabad, ChenniaInterview mode is Walkin driveRequirements :Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)1. Person should be strong in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework3....


  • Bengaluru, India Spruce IT Pvt. Ltd. Full time

    Job Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...


  • Bengaluru, India Capgemini Full time

    Job DescriptionData Ingestion into Foundry from external data sources /legacy systems using using Agents/ Magritte connectors, Data Connection. Working with Raw files.Excellent proficiency in data processing scripting languages like but not limited to Python, Pyspark, sqlDesign, create and maintain a optimal data pipeline architecture in foundryAbility to...

  • Python, Pyspark

    1 month ago


    Bengaluru, India Ziniosedge Full time

    Python, Pyspark 5 Technology Lead (Data Engineer) BE - 8+ years of industry experience as Lead Developer - Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred. - Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling...


  • Bengaluru, India Capgemini Full time

    Job DescriptionData Ingestion into Foundry from external data sources /legacy systems using using Agents/ Magritte connectors, Data Connection. Working with Raw files.Excellent proficiency in data processing scripting languages like but not limited to  Python, Pyspark, sqlDesign, create and maintain a optimal data pipeline architecture in foundryAbility to...

  • Adb + Pyspark + SQL

    1 month ago


    Bengaluru, India RARR Technologies Full time

    **Job Details - ADB + Pyspark + SQL**: **Job ID**: - RARR Job 3323**Job Title**: - ADB + Pyspark + SQL**Job Type**: - Permanent**Job Location**: - Bangalore**Total Experience**: - 5 - 8 Years**Skills**: - Adb, Sql, Pyspark, Azure Databricks, Synapse Analytics**Posted - **23/05/2023 **Job Description**: **Responsibilities**: - Design, develop, and...