Big Data Architect

3 days ago

Gurgaon, India Number Theory Software Pvt.Ltd Full time

**Responsibilities**:

- Evaluate and recommend Big Data technology stack best suited for NT AI at scale Platform and other products
- Lead the team for defining proper Big Data Architecture Design.
- Design and implement features on NT AI at scale platform using Spark and other Hadoop Stack components.
- Drive significant technology initiatives end to end and across multiple layers of architecture
- Provides strong technical leadership in adopting and contributing to open source technologies related to Big Data across multiple engagements
- Designing /architecting complex, highly available, distributed, failsafe compute systems dealing with considerable scalable amount of data
- Identify and work upon incorporating Non-functional requirements into the solution (Performance, scalability, monitoring etc.)

**Requirements**:

- Provides technical leadership in Big Data space (Spark and Hadoop Stack like Map/Reduc, HDFS, Hive, HBase, Flume, Sqoop etc. NoSQL stores like Cassandra, HBase etc) across Engagements and contributes to open-source Big Data technologies.
- Rich hands on in Spark and worked on Spark at a larger scale.Visualize and evangelize next generation infrastructure in Big Data space (Batch, Near Real-time, Realtime technologies).
- Strong understanding and experience in distributed computing frameworks, particularly Apache Hadoop2.0 (YARN; MR & HDFS) and associated technologies one or more of Hive, Sqoop, Avro, Flume, Oozie, Zookeeper, etc.Hands-on experience with Apache Spark and its components (Streaming, SQL, MLLib)

**Good to have**
- Operating knowledge of different enterprise hadoop distribution
- Good Knowledge of Design Patterns
- Experience working within a Linux computing environment, and use of command line tools including knowledge of shell/Python scripting for automating common tasks.

**Salary**: ₹1,000,000.51 - ₹3,000,000.31 per year

**Benefits**:

- Flexible schedule
- Health insurance
- Leave encashment
- Life insurance
- Paid sick time
- Provident Fund

Schedule:

- Day shift

Supplemental pay types:

- Performance bonus

Ability to commute/relocate:

- Gurugram, Haryana: Reliably commute or planning to relocate before starting work (required)

**Experience**:

- Java/Scala: 3 years (preferred)

  • Big Data Architect

    7 days ago

    Gurgaon, India NMS Consultant Full time

    From 9 to 14 year(s) of experience ₹ Not Disclosed by Recruiter - Gurgaon/ Gurugram,Haryana Requires Skill: - Expertise on structured and unstructured data Architecture of big data technology like Hadoop, HDFS, HIVE and other open source tools which are part of Hadoop ecosystem Big Data use case analysis Knowledge of big data analytics RDBMS expertise -...

  • Big Data Tester

    2 weeks ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 6,00,000 - ₹ 15,00,000 per year

    Job Title:Big Data Tester (SQL)Experience:3+YearsLocation:[Gurugram/Bangalore]Employment Type:Full-TimeJob Summary:We are seeking a highly skilledBig Data Tester with strong SQL expertiseto join our team. The ideal candidate will be responsible for validating, testing, and ensuring the quality of large-scale data pipelines, data lakes, and big data...

  • Big Data Developer

    2 weeks ago

    Gurgaon, Haryana, India Viraaj HR Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About The OpportunityA staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across Banking, Retail, Telecom, and SaaS sectors. We partner with product and services organisations to deliver scalable data platforms, real-time analytics, and high-throughput ETL solutions.We are hiring an...

  • Big Data Tester

    2 weeks ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 9,60,000 - ₹ 13,20,000 per year

    Big Data Tester (AWS + SQL) (Immediate joiner)Location:Gurugram / Bangalore (Hybrid)Experience:4–7 YearsBudget:Up to ₹11 LPAAbout the Role:We are looking for a skilled and detail-orientedBig Data Testerwith expertise inAWSandSQLto join our growing team. This role requires hands-on experience in data validation, test automation for big data pipelines, and...

  • Big Data Developer

    2 weeks ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position: Big Data Engineer ( Immediate Joiner)Experience: 5+ YearsLocation: ( Gurugram / Bangalore )Joining: Immediate JoinerBudget LPAJob Summary:We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate...

  • Big Data Developer

    2 weeks ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position: Big Data EngineerExperience: 5+ YearsLocation: ( Gurugram / Bangalore )Joining: Immediate JoinerBudget=16.5 LPAJob Summary:We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate will have...

  • Big Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Insight Global Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Pay Range: LPA (INR)Required Qualifications:3–5 years of hands-on experience in Big Data engineering.Proficiency in Python (Java is a plus).Strong understanding of Google Cloud Platform (GCP) services and architecture. GCP certification is a plus.Solid problem-solving skills and a structured thought process.Experience with data migration and...

  • Senior Big Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Fxconsulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position : Big Data EngineerExperience : 59 Years Job Type : Full-timeJob Summary : We are seeking a highly skilled Big Data Engineer with 59 years of experience to develop, maintain, and optimize robust, scalable big data solutions. This role requires expertise in designing and implementing solutions using Hadoop-based technologies and AWS. The engineer...

  • Big Data Automation QA

    2 weeks ago

    Gurgaon, Haryana, India Xcel HR Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Responsibilities: Develop and automate processes for gathering of expected results from data sources and comparing data results from testing.Assist with the development and maintenance of smoke, performance, functional, and regression tests to ensure code is functioning as designed.Work with the team to understand how changes in the DL affect maintenance of...

  • Big Data Administrator

    5 days ago

    Gurgaon, India Green Arrow Career Services Full time

    **Location**: Gurugram **Experience**: 8 to 10 yrs **Notice Period: 0 to 15 days** **Mandatory Certifications**: - Spark Developer Certification (HDPCD) - HDP Certified Administrator (HDPCA) - Certified Hadoop Administrator **Responsibilities**: - Installing Hadoop in Linux environment. - Deployment in a Hadoop cluster and its maintenance. - Health...