Hadoop/spark

7 days ago


Andhra Pradesh, India Quess IT Staffing Full time

**About Us**

“Magna Infotech, now Quess IT Staffing, is India’s largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names across industried. Quess IT Staffing is a division of Quess Corp Limited, India’s leading business services provider and largest domestic private sector employer. Quess Corp Limited is - ‘A Great Place to Work’ certified - a testament to our excellent culture, people, and processes.”

**About Company**

**Roles and Responsibility**

**Job Description**:
Hadoop/Spark

Exp - 3 to 5years

Np
- 15days to Immediate
- SQL knowledge and experience working on variety of SQL and NoSQL databases.
- Experience with data and model pipeline and workflow management tools.
- Experience in loading data into warehouse environment from diverse sources and formats.
- Experience with one of the popular public cloud platforms (preferably Azure).
- Well versed with Linux & Unix commands.
- Exposure to Big data tools like Hadoop and its ecosystem.
- Experience with ETL Tools: Talend, etc.
- Experience of working in Agile-based projects.
- Good communication and teamwork skills
- Critical thinking and problem-solving abilities


  • Bigdata - Scala, Spark

    3 months ago


    Andhra Pradesh, India Virtusa Full time

    Responsible for **Design, Build & deployment the Solution in Bigdata**. - Minimum **6 to 8 Years of experience **in **Big Data **and Data Engineering using **Scala or Java. (Python good to have)**: - Deep knowledge in **Spark & Scala API Experience is required**. - Good experience in **Hadoop, Big Data, Hadoop centric Schedulers**: - **Big Data and...


  • Uttar Pradesh, India Valiance Analytics Full time

    We are seeking a skilled AWS Hadoop Administrator to join our team and manage our Hadoop infrastructure on the AWS platform. In this role, you will be responsible for deploying, configuring, monitoring, and maintaining our Hadoop clusters to ensure optimal performance, scalability, and reliability. As an integral member of our IT operations team, you will...


  • madhya pradesh, India ClearTrail Technologies Full time

    Job Title: Lead -Hadoop Technical SupportRole Big Data Infrastructure Implementation and SupportExperience: 8 to 12 years of experience in Big Data, Apache Hadoop System Implementation, and administration.Education: BE (IT/Computers), B.Tech, M.Tech, MCAWork Location : Riyadh, Saudi ArabiaCertifications: Apache Hadoop administration (Big Data Hadoop...

  • Pyspark QA

    7 months ago


    Andhra Pradesh, India Virtusa Full time

    **JOB DESCRIPTION** **Skill: PySpark QA** **Role / Tier: Lead Software Engineer/Tier 2** **Experience: 6 - 9 years** Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore, aggregate, transform, store & analyse installing, configuring,...

  • Python Scripting

    3 months ago


    Andhra Pradesh, India Virtusa Full time

    Python Scripting Led Primary Skills Python scripting Data Scikit learn Py Spark Data mining, AI JD Design and build new tools as well as enhancements to existing our surveillance and monitoring tools for the compliance business community Develop solutions using Python, Hadoop, Spark, and HIVE/SQL Work on projects that require deep knowledge of Python and...

  • Java Aws Architect

    2 months ago


    Andhra Pradesh, India Virtusa Full time

    15 years of Architecting & Developing Experience working in Big Data Technologies using Apache, Hadoop, Spark & SQL etc. 5 years of strong Development/ Coding experience using Spark with Python Minimum 3 Years experience working on Databricks on AWS based Cloud Services 5 years of strong experience in Big Data design, modelling & Development such as star...


  • Andhra Pradesh, India Virtusa Full time

    12+ years of Architecting & Developing Experience working in Big Data Technologies using Apache Hadoop, Spark & SQL etc. 5+ years of strong Development Coding experience using Spark with Python Minimum 3+ Years experience working on Databricks on AWS based Cloud Services 5+ years of strong experience in Big Data design, modelling & Development such as star...

  • Data Qe

    7 months ago


    Andhra Pradesh, India Virtusa Full time

    Completed GCP certification Good communication skills Should have very good experience on preparing test scenarios, suite, test cases. Should have solid experience on test coverage, test execution and reporting. Should have good knowledge on data mapping (source, target, transformation, filter, etc) Should have experience on DbVisulizer or beeline or...

  • Data Testing

    6 months ago


    Andhra Pradesh, India Virtusa Full time

    Completed GCP certification Good communication skills Should have very good experience on preparing test scenarios, suite, test cases. Should have solid experience on test coverage, test execution and reporting. Should have good knowledge on data mapping (source, target, transformation, filter, etc) Should have experience on DbVisulizer or beeline or...

  • Aiml

    3 weeks ago


    Andhra Pradesh, India Virtusa Full time

    Design, implement, and manage MLOps pipelines using Azure MLFlow, AWS SageMaker, Vertex.ai, Dataiku, and H2O.ai. Automate the deployment, monitoring, and scaling of machine learning models. Collaborate with data scientists and software engineers to integrate ML models into production environments. Ensure the reliability, scalability, and performance of ML...

  • Etl QA

    4 weeks ago


    Andhra Pradesh, India Virtusa Full time

    Design thorough ETL testing solutions Implement tests that are logical, extensible and thorough Create scripts that cover UI, Functional, Regression and E2E requirements Mentor the team on test practices Make informed decisions quickly and take ownership of quality solutions About you: You will have up to 7 years of experience testing commercial software in...

  • Data Architect

    3 weeks ago


    Andhra Pradesh, India Virtusa Full time

    Job Description: Design, develop, and maintain scalable data pipelines and systems using DBT and Big Data technologies. Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. Implement data models and transformations using DBT. Develop and maintain ETL processes to ingest and process large...

  • Airflow

    3 weeks ago


    Andhra Pradesh, India Virtusa Full time

    Mandatory Skills: AWS Data Services, Python, SQL, Data Lake Secondary Skills: DBT, Airflow, DevOps JD: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. Key Responsibilities: Design, develop, and maintain scalable data pipelines and systems on AWS. Implement and manage ETL processes using Python and Apache...


  • Andhra Pradesh, India Virtusa Full time

    Data Modeler (Architect): JD 10+ years of experience in data modeling, database design, or related roles. Experience in relational, dimensional, and/or analytic experience (using RDBMS, dimensional, NoSQL data platform technologies, and ETL and data ingestion protocols). Proven experience in designing data models for ETL/ELT processes and data warehouses in...

  • Talend

    4 weeks ago


    Andhra Pradesh, India Virtusa Full time

    Role : TALEND Sr Developer **Job Description**: Key Responsibilities ETL Development: Design, develop, and optimize ETL/ELT processes using Talend Data Integration and other Talend components. Data Transformation: Implement data cleansing, transformation, and enrichment processes to support analytics and operational needs. Integration Solutions: Develop and...

  • Gen Ai

    3 months ago


    Andhra Pradesh, India Virtusa Full time

    We are seeking a highly skilled and motivated Data Scientist with expertise in LLM (Language and Learning Models) solution building to join our team. As a Data Scientist, you will be responsible for leveraging advanced analytics techniques and machine learning algorithms to develop innovative solutions using LLM technologies. You will work closely with...


  • uttar pradesh, India Coforge Full time

    Role: Senior Data EngineerSkills: ADF, Databricks, and Spark Streaming DeveloperExperience: 5-8+ YearsLocation: Noida, Gurugram,Responsibilities:Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks.Implement real-time data processing solutions using Spark Streaming.Collaborate with data engineers, data scientists, and...


  • uttar pradesh, India Intellicus Technologies Full time

    Experience: 3-7 yearsJob Location: Noida/Indore/BangaloreQualification:Experience in writing and troubleshooting SQL or MDX queries.Proficient in database design techniques and data modeling.Proven hands-on experience in designing, developing, and supporting Database projects for analysis.Good written and verbal communication skills.Knowledge and/or...

  • Software Engineer

    2 months ago


    uttar pradesh, India Intellicus Technologies Full time

    IntellicusIntellicus is a Big Data BI & Analytics Product company. We simplify the exploration, analysis and visualization of big data for world's largest companies. We are the first company to innovate OLAP on Big Data.Intellicus is a provider of BI and Analytics products to Fortune 500 companies for more than a decade. It has created a footprint of over...

  • Computer Scientist I

    4 months ago


    Noida, Uttar Pradesh, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...