Big Data

2 days ago

Pune, India Virtusa Full time

**Duties & Responsibilities**:

- Requirement Analysis, Design, Develop and Deploy project/tasks while adhering to existing SDLC standards.
- Provide project/task effort estimates.
- Provide regular project progress & Issue report.
- Partner with multiple teams to deliver projects.
- Scope and deliver various Big Data solutions.
- Ability to design solutions independently based on high-level architecture.
- Manage the technical communication between the survey vendor and internal systems.
- Provide L3 support on delivered projects.
- Adapt to changing needs, both technology and nature of projects.
- Design, Model, Develop & Deploy Data ingestion tasks using approved toolset.
- Develop automated monitoring tools using available standard tools (shell script/Python/Java/Scala etc.).
- Data conversion/migration in/into Bigdata platform.

**Job requirements and qualifications**:

- Big Data Engineer job description should contain the following requirements and qualifications:

- 4 -6 years of experience as a Big Data Engineer or similar role.
- Working knowledge of Infrastructure is a must.
- 3 - 5 years of experience programming and/or architecting a backend language (Script, Python, Scala, Java etc.).
- Experience with Shell scripting, Python, Spark, Scala, or the Hadoop ecosystem and similar frameworks.
- Experience with Avro, Parquet, HBase, Hive, Impala, Arcadia.
- Experience with Data migration and Data enrichment in Hadoop space.
- Experience with non-relational & relational databases (Oracle, SAP, MySQL, NoSQL, Hadoop, MongoDB, etc.)
- Creative and innovative approach to problem-solving.
- Crisp communication & Intrapersonal skill is a must.

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 36,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Big Data

    3 days ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS Skill: Big Data Years of Experience: 6 - 12 years Location: Pune/ Mumbai/ Chennai Notice Period: 0 - 45 days Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data

    5 days ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data

    7 days ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS Skill: Big Data Years of Experience: 6 - 12 years Location: Pune/ Mumbai/ Chennai Notice Period: 0 - 45 days Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Professional

    2 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job TitleWe are currently seeking a highly skilled Big Data professional to join our team. The ideal candidate will have 6-12 years of experience in Big Data and related technologies.Key Skills:More than 5.8 years of experience in data engineering and architecture.Proficiency in Spark, Scala, Java, and SQL.Strong understanding of data structures and...

  • Big Data Developer

    1 day ago

    Pune, Maharashtra, India MRO Full time

    Analyst - Big Data DeveloperWe are seeking a highly skilled Analyst -Big Data Developer to join our dynamic team.The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.You will be responsible for designing, implementing, and maintaining...

  • Big Data Specialist

    14 minutes ago

    Pune, Maharashtra, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Expert - Big Data SpecialistDescription:We are seeking a highly skilled professional to join our team. The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.Main Responsibilities:Data Solutions: Design and implement robust...

  • Big Data

    4 weeks ago

    Pune, Maharashtra, India Atgeir Solutions Full time

    Job DescriptionATG_JOB_0059Advanced Data AnalyticsGlobal Delivery Center (Pune)Full Time10-15 ExperienceMinimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir&aposs Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required...

  • Big Data Expert

    3 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Big Data DeveloperThis role is ideal for a skilled and ambitious professional with expertise in big data technologies. As a Big Data Developer, you will play a key part in designing, developing, and maintaining large-scale data processing systems using Hadoop, Spark, and NoSQL databases.Key Responsibilities:Develop scalable data pipelines using Apache Kafka,...

  • Big Data Engineer

    22 hours ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Administrator

    2 weeks ago

    Pune, India TransUnion Full time

    TransUnion's Job Applicant Privacy Notice **What We'll Bring**: We’re looking for a Big Data Administrator to join our growing Big Data Administration team. You will be based both from our offices in Leeds and working remotely as part of our ‘flex together’ approach. In this fast-paced role you’ll work with Data Engineering and Data Science teams to...