Python+Spark+cloud

3 weeks ago

Bengaluru, India Wissen Full time

Wissen Technology is now hiringPython+Spark+cloud

We are seeking a skilled Python Developer with a strong background in Spark and Cloud technologies. The ideal candidate will be responsible for developing, maintaining, and optimizing scalable data processing pipelines and integrating them with cloud-based infrastructure.

Experience–5-8years

Location:Bangalore

Requirements:

• Develop, maintain, and optimize scalable data processing pipelines using Python and Spark.

• Design and implement cloud-based solutions using platforms such as AWS, Azure, or Google Cloud.

• Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and deliver high-quality solutions.

 • Write clean, efficient, and maintainable code following best practices and coding standards

. • Perform data analysis and ensure data quality and integrity.

• Monitor and troubleshoot performance issues in the data processing pipelines and cloud infrastructure.

 • Implement and maintain CI/CD pipelines for automated testing and deployment.

• Stay up to date with the latest industry trends and technologies in Python, Spark, and Cloud computing

Required Skills and Qualifications:

 • Bachelor's or master's degree in computer science, Engineering, or a related field.

 • Proven experience as a Python Developer with expertise in Spark and Cloud technologies.

 • Strong knowledge of Python and its libraries (, Pandas, NumPy).

• Experience with Apache Spark, including Spark SQL, DataFrames, and Spark Streaming.

• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.

• Proficiency in SQL and experience with relational databases.

• Familiarity with containerization and orchestration tools such as Docker and Kubernetes.

• Experience with version control systems such as Git.

• Strong problem-solving skills and attention to detail.

• Excellent communication and teamwork skills

About Wissen Technology:

The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world class products.

We offer an array of services including Core Business Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud Adoption, Mobility, Digital Adoption, Agile & DevOps, Quality Assurance & Test Automation.

Over the years, Wissen Group has successfully delivered $1 billion worth of projects for more than 20 of the Fortune 500 companies. Wissen Technology provides exceptional value in mission critical projects for its clients, through thought leadership, ownership, and assured on-time deliveries that are always ‘first time right’.

The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them with the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients.

We have been certified as a Great Place to Work company for two consecutive years (2020-2022) and voted as the Top 20 AI/ML vendor by CIO Insider. Great Place to Work Certification is recognized world over by employees and employers alike and is considered the ‘Gold Standard’. Wissen Technology has created a Great Place to Work by excelling inall dimensions - High-Trust, High-Performance Culture, Credibility, Respect, Fairness, Pride and Camaraderie.

  • Python+Spark+cloud

    2 weeks ago

    Bengaluru, India Wissen Full time

    Wissen Technology is now hiringPython+Spark+cloudWe are seeking a skilled Python Developer with a strong background in Spark and Cloud technologies. The ideal candidate will be responsible for developing, maintaining, and optimizing scalable data processing pipelines and integrating them with cloud-based...

  • Python+Spark+cloud

    5 days ago

    Bengaluru, Karnataka, India Wissen Full time

    Wissen Technology is now hiringPython+Spark+cloudWe are seeking a skilled Python Developer with a strong background in Spark and Cloud technologies. The ideal candidate will be responsible for developing, maintaining, and optimizing scalable data processing pipelines and integrating them with cloud-based...

  • Senior Data Engineer

    2 months ago

    Bengaluru, India SPN Globe Full time

    Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB.Job Description :1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting capabilities...

  • Azure Data Engineer

    2 months ago

    Bengaluru, India Smart Consulting - Creating Future Leaders Full time

    EARLY JOINERS WILL BE PREFERABLE. Company : BIG 4 MNC. Role : Azure Data Engineer. Location : Bangalore. Experience : 3-8 Years. CTC : 22 LPA Max (Depends on current CTC, experience, skills). Mandatory skills : Azure, Azure Cloud, Azure Databricks, Azure Datafactory, Azure Datalake, Python, SQL, Relational databases (Oracle, DB2, SQL Server), Spark, Agile....

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India SPN Globe Full time

    Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB.Job Description :1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting capabilities...

  • Azure Data Engineer

    3 weeks ago

    Bengaluru, India Smart Consulting - Creating Future Leaders Full time

    EARLY JOINERS WILL BE PREFERABLE. Company : BIG 4 MNC. Role : Azure Data Engineer. Location : Bangalore. Experience : 3-8 Years. CTC : 22 LPA Max (Depends on current CTC, experience, skills). Mandatory skills : Azure, Azure Cloud, Azure Databricks, Azure Datafactory, Azure Datalake, Python, SQL, Relational databases (Oracle, DB2, SQL Server), Spark, Agile....

  • Technical Lead-ADF/spark/Kafka

    5 days ago

    Bengaluru, India Wipro Full time

    Tech Lead-Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platformRoleSr.Data EngineerYears of Experience5-7 YrsPreferred LocationHYD 2Shift Timing (IST)11:00 AM - 08:30 PMShort DescriptionDevelop batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on the Azure Cloud platform, as well as implement and...

  • Technical Lead-ADF/spark/Kafka

    3 days ago

    Bengaluru, India Wipro Full time

    Tech Lead- Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platform Role Sr.Data Engineer Years of Experience 5-7 Yrs Preferred Location HYD 2 Shift Timing (IST) 11:00 AM - 08:30 PM Short Description Develop batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on the Azure Cloud platform, as well as...

  • Data Engineer

    3 weeks ago

    Bengaluru, India VDart Software Services Pvt. Ltd. Full time

    Job Description:Mandatory - Hands on spark scala programming, experience in working in data lakes, data migration project, AWS cloudStrong proficiency in Scala, with a minimum of 2 years' experience in a data lake environment -- MUSTExpertise in technologies such as Impala, Spark, Python, Java, and SQL.Cloud migration experience, particularly with AWS...

  • Data Engineer

    3 weeks ago

    Bengaluru, India VDart Software Services Pvt. Ltd. Full time

    Job Description:Mandatory - Hands on spark scala programming, experience in working in data lakes, data migration project, AWS cloudStrong proficiency in Scala, with a minimum of 2 years' experience in a data lake environment -- MUSTExpertise in technologies such as Impala, Spark, Python, Java, and SQL.Cloud migration experience, particularly with AWS...

  • Technical Lead-adf/spark/kafka

    5 days ago

    Bengaluru, Karnataka, India Wipro Full time

    Tech Lead- Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platformRoleSr.Data EngineerYears of Experience5-7 YrsPreferred LocationHYD 2Shift Timing (IST)11:00 AM - 08:30 PMShort DescriptionDevelop batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on the Azure Cloud platform, as well as implement and...

  • Evnek - Senior Data Engineer - Python/Spark

    5 days ago

    Bengaluru, Karnataka, India Evnek Technologies Full time

    Job Description :Experience working with distributed technology tools for- developing Batch and Streaming- pipelines using SQL, Spark, Python, PySpark (4+ years), Airflow (3+ years), Scala (2+ years). Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for Managed Spark...

  • Data Engineer

    3 weeks ago

    Bengaluru, India Protiviti Full time

    JOB DESCRIPTION :- 6+ years of overall technology experience that includes at least 5+ years of hands-on data engineering utilizing the power of Python and the Apache Spark framework to design, build, and maintain data pipelines and perform large-scale data processing tasks.- Writing efficient and scalable data processing applications using PySpark APIs and...

  • Senior Data Engineer- Spark/Python

    2 months ago

    Bengaluru, India iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Senior Data Engineer- Spark/Python

    3 weeks ago

    Bengaluru, India iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Data Enginner

    7 days ago

    Bengaluru, Karnataka, India CoffeeBeans Consulting Full time

    Founded in the year 2017, CoffeeBeans specializes in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of delivery through impactful product launches, process simplification, and help build competencies that drive business outcomes across industries. The company uses...

  • Senior Data Engineer- Spark/Python

    5 days ago

    Bengaluru, Karnataka, India iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Technical Lead-ADF/spark/Kafka

    5 days ago

    Bengaluru, India Wipro Full time

    Tech Lead-Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platform RoleSr.Data EngineerYears of Experience5-7 YrsPreferred LocationHYD 2Shift Timing (IST)11:00 AM - 08:30 PMShort DescriptionDevelop batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on the Azure Cloud platform, as well as implement and...

  • Senior Data Engineer

    2 months ago

    Bengaluru, India MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Primary skillset :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python [6+ years], Airflow [4+ years], Scala [4+ years].- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming languages, technologies, and frameworks.- Strong skills building...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Primary skillset :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python [6+ years], Airflow [4+ years], Scala [4+ years].- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming languages, technologies, and frameworks.- Strong skills building...