Pyspark Dsa 4 to 8 Years Pan India

6 months ago


Bengaluru Karnataka, India Capgemini Full time

**Job Description**:

- Bachelor’s or master’s degree in computer science, Engineering, or related field
- 5-8 years of experience in data engineering and machine learning
- Extensive experience with Python programming, including Pandas, NumPy, and various libraries for data manipulation and analysis
- Hands-on experience with Spark architecture, including data frame operations, lazy evaluation, and UDFs
- Strong understanding of DevOps principles and experience with tools like Docker, Kubernetes, and Jenkins
- Familiarity with machine learning libraries such as Spark ML-lib or Azure ML is a plus
- Previous experience in product-oriented organizations or Tier 1 companies is preferred

**Primary Skills**:

- Utilize advanced SQL techniques such as joins with in-line views and self-joins for data manipulation and extraction
- Proficient in Python programming, including but not limited to variables, functions, loops, conditions, and various data structures
- Implement object-oriented programming concepts including polymorphism, abstract classes, and interfaces for code modularity and reusability
- Develop and maintain data pipelines using Spark architecture, understanding nodes, clusters, lazy evaluation, and DAG in Spark
- Perform data frame operations and user-defined functions (UDFs) for efficient data processing in Spark
- Integrate APIs for data retrieval and interaction with external systems
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions

**Secondary Skills**:

- Good Communication Skills



  • Bengaluru, Karnataka, India Capgemini Invent Full time

    **At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science...


  • Bengaluru, Karnataka, India Capgemini Full time

    **Job Description**: - Proficient in leveraging Spark for distributed data processing and transformation. - Skilled in optimizing data pipelines for efficiency and scalability. - Experience with real-time data processing and integration. - Familiarity with Apache Hadoop ecosystem components. - Strong problem-solving abilities in handling large-scale...


  • Bengaluru, India Capgemini Full time

    Job Description 4+ years hands-on experience as a pySpark developer  Proven track record on managing large teams Strong programming skills in Python Familiarity with big data processing tools and techniques Experience with the Hadoop ecosystem Good understanding of distributed systems Experience with streaming data platforms Excellent...


  • Bengaluru, Karnataka, India KSmart Staffing Solutions Full time

    **Job brief**: We are seeking a Siebel System Administration for the Pan India locations **Responsibilities**: The consultant must have good knowledge in following areas - Administration of Siebel enterprise, Server Server component configuration - Knowledge of Siebel IP24 architecture - Knowledge of workspaces - Knowledge of siebel upgrade would have added...


  • Bengaluru, India Capgemini Full time

    **Job Description**: - professional experience in database management, data solution development, data transformation, and data quality assurance. - Proficiency in using Palantir tools, including Code repository, Ontology manager, Object view, Workshop (dashboard, action Forms), and Data Connection. - Strong hands-on experience with Python and PySpark,...


  • Bengaluru, India Capgemini Full time

    professional experience in database management, data solution development, data transformation, and data quality assurance. - Proficiency in using Palantir tools, including Code repository, Ontology manager, Object view, Workshop (dashboard, action Forms), and Data Connection. - Strong hands-on experience with Python and PySpark, demonstrating the ability to...


  • Bengaluru, Karnataka, India Minutes to Seconds Pty Ltd Full time

    About the JobAt Minutes to Seconds, we're on a mission to match talented individuals with the perfect job opportunities. Our goal is to provide a seamless fit between skills and roles, driving success for both our candidates and clients.We're currently seeking a skilled Senior PySpark Developer to join our dynamic team. As a key member of our team, you'll be...

  • DSA Mentor

    1 month ago


    Bengaluru, India PW (PhysicsWallah) Full time

    Company OverviewPhysicsWallah is a leading e-learning company with a mission to provide high-quality and affordable education to students. With over 6 million students and a dedicated team of faculty members, PhysicsWallah is committed to helping students succeed in their entrance exams.Job OverviewWe are hiring a DSA Mentor who will be responsible for...


  • Bengaluru, India Minutes to Seconds Pty Ltd Full time

    About the job At Minutes to Seconds, we match people having great skills with tailor-fitted jobs to achieve well-deserved success. We know how to match people to the right job roles to create that perfect fit. This changes the dynamics of business success and catalyzes the growth of individuals. Our aim is to provide both our candidates and clients with...


  • Bengaluru, Karnataka, India Capgemini Full time

    **Job Description**: - **A minimum of 3 to 4 years of hands-on experience in SAP Global Trade Services GTS integration advisory and delivery.**: - **Experience in configuring and implementing one or more of the following SAP GTS Modules**: **1 Compliance Management SAP GTS Compliance** **2 Customs Management SAP GTS Customs** **3 Risk Management SAP GTS...


  • Bengaluru, India Tata Consultancy Services Full time

    Cosmos DB 4-1-YRS-Pan IndiaJD-- Management of cloud-hosted databases administration including AWS, Azure, Google Cloud knowledge- Experience of COSMOS databases- Management COSMOS DBA in cloud environment, management, configuration on cloud-Good-to-HaveSQL Server DBA, Basic Could technologies knowledge(AWS, Azure, GCP)Role descriptions / Expectations from...


  • Whitefield, Bengaluru, Karnataka, India People Prime Worldwide Full time

    **About company** Our Company is global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84,000 entrepreneurial professionals across more than 30 countries it covers to over 700 clients. With its extensive domain and...


  • Bengaluru, Karnataka, India Capgemini Full time

    **Job Description**: **- 4-8 years of experience in Full stack with Angular, HTML, CSS, Java, Rest API, Spring and Spring boot** **- Good experience/knowledge in Microservices** **- CI/CD experience must have** **- Exposure to Cloud deployment activities** **Primary Skills**: **- 4-8 years of experience in Full stack with Angular, HTML, CSS, Java, Rest...


  • Bengaluru, Karnataka, India Capgemini Full time

    **Job Description**: - 4-8 years of experience in Full stack with Angular, HTML, CSS, Java, Rest API, Spring and Spring boot - Good experience/knowledge in Microservices - CI/CD experience must have - Exposure to Cloud deployment activities **Primary Skills**: - 4-8 years of experience in Full stack with Angular, HTML, CSS, Java, Rest API, Spring and...


  • Bengaluru, India KreditBee Full time

    Roles and ResponsibilitiesDevelop DSA/Offline channels for sourcing Business loans: A target-oriented role workingwith the business teams for sourcing unsecured business loans via DSA/other offline channels.Activities and Tasks• Identify and engage with top tier DSA networks/offline channels for sourcing businessloans and scale these channels over a period...


  • Bengaluru, Karnataka, India DSA GLOBAL PRIVATE LIMITED Full time

    **Job Title**: Receptionist **Location**: Bangalore **Company**: DSA Global (Study Abroad Consultancy) **Salary**: ₹30,000 per month **Working Hours**: 10:00 AM - 7:00 PM **About Us**: DSA Global is a prominent study abroad consultancy dedicated to helping students achieve their educational goals overseas. **Position Overview**: **Key...


  • Bengaluru, Karnataka, India Wall Street Consulting Services LLC Full time

    Job Title: Senior Azure Data EngineerLocation: PAN IndiaDuration: Long-termAbout the Role:We are seeking an experienced Senior Azure Data Engineer to join our team at Wall Street Consulting Services LLC. The ideal candidate will have a strong background in data engineering, with expertise in ADF, Spark, Databricks, and Azure.Key Responsibilities:Maintain and...


  • Bengaluru, India Tata Consultancy Services Full time

    Cosmos DB 4-1-YRS-Pan IndiaJD-Management of cloud-hosted databases administration including AWS, Azure, Google Cloud knowledge Experience of COSMOS databasesManagement COSMOS DBA in cloud environment, management, configuration on cloudGood-to-Have SQL Server DBA, Basic Could technologies knowledge(AWS, Azure, GCP)Role descriptions / Expectations from the...


  • Bengaluru, India Tata Consultancy Services Full time

    Cosmos DB 4-1-YRS-Pan IndiaJD-Management of cloud-hosted databases administration including AWS, Azure, Google Cloud knowledge Experience of COSMOS databasesManagement COSMOS DBA in cloud environment, management, configuration on cloudGood-to-Have SQL Server DBA, Basic Could technologies knowledge(AWS, Azure, GCP)Role descriptions / Expectations from the...


  • Bengaluru, India Minutes to Seconds Pty Ltd Full time

    About the jobAtMinutes to Seconds we match people having great skills withtailorfitted jobs to achieve welldeserved success. We know how tomatch people to the right job roles to create that perfect fit.This changes the dynamics of business success and catalyzes thegrowth of individuals. Our aim is to provide both our candidatesand clients with great...