Big Data Architect

1 week ago

Gurgaon, India Number Theory Software Pvt.Ltd Full time

**Responsibilities**:

- Evaluate and recommend Big Data technology stack best suited for NT AI at scale Platform and other products
- Lead the team for defining proper Big Data Architecture Design.
- Design and implement features on NT AI at scale platform using Spark and other Hadoop Stack components.
- Drive significant technology initiatives end to end and across multiple layers of architecture
- Provides strong technical leadership in adopting and contributing to open source technologies related to Big Data across multiple engagements
- Designing /architecting complex, highly available, distributed, failsafe compute systems dealing with considerable scalable amount of data
- Identify and work upon incorporating Non-functional requirements into the solution (Performance, scalability, monitoring etc.)

**Requirements**:

- Provides technical leadership in Big Data space (Spark and Hadoop Stack like Map/Reduc, HDFS, Hive, HBase, Flume, Sqoop etc. NoSQL stores like Cassandra, HBase etc) across Engagements and contributes to open-source Big Data technologies.
- Rich hands on in Spark and worked on Spark at a larger scale.Visualize and evangelize next generation infrastructure in Big Data space (Batch, Near Real-time, Realtime technologies).
- Strong understanding and experience in distributed computing frameworks, particularly Apache Hadoop2.0 (YARN; MR & HDFS) and associated technologies one or more of Hive, Sqoop, Avro, Flume, Oozie, Zookeeper, etc.Hands-on experience with Apache Spark and its components (Streaming, SQL, MLLib)

**Good to have**
- Operating knowledge of different enterprise hadoop distribution
- Good Knowledge of Design Patterns
- Experience working within a Linux computing environment, and use of command line tools including knowledge of shell/Python scripting for automating common tasks.

**Salary**: ₹1,000,000.51 - ₹3,000,000.31 per year

**Benefits**:

- Flexible schedule
- Health insurance
- Leave encashment
- Life insurance
- Paid sick time
- Provident Fund

Schedule:

- Day shift

Supplemental pay types:

- Performance bonus

Ability to commute/relocate:

- Gurugram, Haryana: Reliably commute or planning to relocate before starting work (required)

**Experience**:

- Java/Scala: 3 years (preferred)

  • Big Data Architect

    3 days ago

    Gurgaon, India Techfrolic Software Solutions Pvt. Ltd Full time

    **Job description** We are seeking a highly skilled and experienced Big Data Architect to join our team. As a Big Data Architect, you will be responsible for designing and implementing robust, scalable, and high-performance big data solutions that meet our client's diverse and complex requirements. Your expertise in big data technologies, data modeling, and...

  • Big Data Architect

    2 weeks ago

    Gurgaon, India NMS Consultant Full time

    From 9 to 14 year(s) of experience ₹ Not Disclosed by Recruiter - Gurgaon/ Gurugram,Haryana Requires Skill: - Expertise on structured and unstructured data Architecture of big data technology like Hadoop, HDFS, HIVE and other open source tools which are part of Hadoop ecosystem Big Data use case analysis Knowledge of big data analytics RDBMS expertise -...

  • Senior Big Data Architect Position

    2 weeks ago

    Gurgaon, Haryana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Role SummaryThis is an exciting opportunity to work as a Big Data Architect with our organization. The ideal candidate will have extensive experience in data engineering, data warehousing, and big data processing.The key responsibilities of this role include designing and implementing end-to-end data engineering solutions using a combination of Python and...

  • Big Data Strategist

    2 weeks ago

    Gurgaon, Haryana, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    AWS Data Architect RoleKey characteristics of a successful AWS Data Architect include hands-on experience in Big Data and Cloud Technologies. The ideal candidate will possess expertise in designing and developing applications using Big Data, DWH, Cloud technologies, ETL, SQL.Primary Responsibilities:Develop a modernization approach and strategy for the...

  • Big Data Architect

    2 weeks ago

    Gurgaon, Haryana, India beBeeData Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    Senior Data Engineer PositionWe're seeking an experienced Senior Big Data Engineer to spearhead the design, development, and implementation of large-scale data systems using Redshift, AWS, Spark, and Scala.Data Architecture- Design and develop large-scale data warehouses using Amazon Redshift to maximize efficiency and scalability.- Optimize Redshift cluster...

  • Big Data Systems Architect

    1 week ago

    Gurgaon, Haryana, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Systems ArchitectWe are seeking a skilled professional to design, develop and maintain large-scale data systems.Key Responsibilities:Evaluate and implement data governance practices to ensure high-quality data across the organization.Develop and enforce data principles and policies aligned with the data governance framework to guarantee...

  • Big Data Tester

    1 week ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title:Big Data Tester (SQL)Experience:3+YearsLocation:[Gurugram/Bangalore]Employment Type:Full-TimeJob Summary:We are seeking a highly skilledBig Data Tester with strong SQL expertiseto join our team. The ideal candidate will be responsible for validating, testing, and ensuring the quality of large-scale data pipelines, data lakes, and big data...

  • Big Data Architect

    7 days ago

    Gurgaon, India NMS Consultant Full time

    Required Skills (must have): - Strong Knowledges/hands-on experience about offers and features of Big data technologies (especially Hadoop, Hortonworks) - Strong experience of development using Spark Scala, Java, JavaScript, Nifi, Kafka, Hive, Hbase - Strong knowledge of API development - Strong knowledge of the java frameworks (Spring MVC, Spring...

  • Big Data Tester

    1 week ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 11,00,000 per year

    Big Data Tester (AWS + SQL) (Immediate joiner)Location:Gurugram / Bangalore (Hybrid)Experience:4–7 YearsBudget:Up to ₹11 LPAAbout the Role:We are looking for a skilled and detail-orientedBig Data Testerwith expertise inAWSandSQLto join our growing team. This role requires hands-on experience in data validation, test automation for big data pipelines, and...

  • Data Architect

    2 weeks ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerWe are seeking a skilled and experienced Data Architect to drive integration and analytics for digital marketing and web platforms. This role involves working with clickstream data, building customer intelligence, and optimizing big data ecosystems for enhanced decision-making.Key Responsibilities:Design and develop large-scale data...