Hadoop Architect

4 weeks ago

Mumbai, India CLIQHR Recruitment Services Full time
At least 10 years of experience working across/understanding of one or more ETL/Big Data tools
Atleast 5 years of experience working in Big Data Technologies Java Spark technical 4+ years of experience in Java Spark At least 5 years of experience in Data warehousing
Strong understanding and hands-on experience on the Big Data stack (HDFS, Sqoop, Hive, Java etc.)
Big Data solution design and architecture Design, sizing and implementation of Big Data platforms based Deep understanding of Cloudera and or Hortonworks stack (Spark, Installation and configuration, Navigator, Oozie, Ranger etc.)
Experience in extracting data from feeds into Data Lake using Kafka and other open source components Understanding of and experience in Data ingestion patterns and experience with building pipelines.
Experience in configuring Azure or AWS components and managing data flows.
Knowledge of Google Cloud Platform a plus.
Experience work on Production grade projects with Terabyte to Petabyte size data sets. Build a scalable, reliable, operable and performant big data platform for both streaming and batch analytics Design and implement data aggregation, cleansing and transformation layers Skills Required: Apache NiFi, Kafka Connect (Confluent), Sqoop, Kylo, Spark, Druid, Presto, RESTful services, Lambda / Kappa architectures, Airflow 3+ years of hands-on experience designing and operating large data platforms
Experience in Big data Ingestion, Transformation and stream / batch processing technologies using Apache NiFi, Apache Kafka, Kafka Connect (Confluent), Sqoop, Spark, Storm, Hive etc;
Experience in designing and building streaming data platforms in Lambda, Kappa architectures Should have working experience in one of NoSQL, OLAP data stores like Druid, Cassandra, Elasticsearch, Pinot etc;
Experience in one of data warehousing tools like RedShift, BigQuery, Azure SQL Data Warehouse
Exposure to other Data Ingestion, Data Lake and querying frameworks like Marmaray, Kylo, Drill, Presto Experience in designing and consuming microservices Exposure to security and governance tools like Apache Ranger, Apache Atlas
Experience in performance benchmarks Any contributions to open source projects Basic Expectation
Must have excellent written and verbal communication skills to communicate with various stakeholders within organization.
Demonstrates excellent process, documentation, team participation and problem - solving skills Must have self-learning skills for performing the tasks by deadline Requirement gathering and understanding, Analyze and convert functional requirements into concrete technical tasks.
Primary Skills: Java Spark, Hive, HDFS, Kafka, Impala, HBase, Hadoop MapReduce Core JAVA, Linux shell scripting Restful APIs
Other required Skills: Agile/Scrum methodology experience is required.
Experience in SCMs like GIT; and tools like JIRA Experience in RDMS and No SQL databases Strong experience in Data Structures, Algorithms etc Well versed with SDLC life cycle having exposure to various Phases
Strong hands-on working experience in multiple Big data and Cloud technologies Good to have Datawarehouse exposure Responsible for systems analysis - Design, Coding and Unit Testing

  • Big Data Architect/Practice Lead

    2 weeks ago

    Mumbai, India HR Central Full time

    Key Responsibilities :As an Bigdata Architect / Practice Lead, you will :- Work closely with Founder and CEO in establishing multi-year growth plan and be accountable for day to day execution against the plan and on shaping the future of the practice- Be responsible for Solution Architecture, Clients and delivery across Data Engineering, Cloud platforms &...

  • EY - Big Data Lead - Data Warehousing/Hadoop

    1 month ago

    Pune,Bangalore,Hyderabad,Mumbai,Navi Mumbai,Delhi NCR, India Ernst and Young Services Pvt. Ltd Full time

    Overview :The Data & Analytics team is looking for a Big Data Lead Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principal in the Big Data space. The Hadoop Data Warehouse is being used by various groups to...

  • Senior Data Engineer

    2 weeks ago

    Mumbai, India Symbiosis Management Consultants Full time

    Job Description : We are seeking a Senior Data Engineer with extensive experience in Azure to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and infrastructure on the Azure cloud platform. This role requires a strong background in data engineering, along with expertise in Azure...

  • Big Data Architect| Leading Manufacturing Giant| Mumbai/ Pune

    4 weeks ago

    Mumbai, India Michael Page Full time

    Be a part of a fast-paced meritocratic organization.Competitive compensation & opportunity to be a part of a growing team.About Our ClientLeading Manufacturing GiantJob DescriptionDevelop and implement robust data architectures for managing structured and unstructured data across the enterprise.Design scalable and efficient data storage solutions to support...

  • Big Data Architect| Leading Manufacturing Giant| Mumbai/ Pune

    1 month ago

    mumbai, India Michael Page Full time

    Be a part of a fast-paced meritocratic organization. Competitive compensation & opportunity to be a part of a growing team. About Our Client Leading Manufacturing Giant Job Description Develop and implement robust data architectures for managing structured and unstructured data across the enterprise. Design scalable and efficient...

  • Azure Cloud Solution Architect

    1 month ago

    Mumbai, India Predoole Analytics Full time

    Location: Mumbai/Pune Experience: 3 years +/8 years+ **ABOUT PREDOOLE ANALYTICS** Predoole Analytics is a Data Engineering company providing actionable insights to CXOs with their expertise in niche disruptive technologies. We are Elite partner of OEMs like Qlik, Gold partner of Microsoft and work in technologies like Snowflake. We pride ourselves to...

  • Architect - Data Engineer

    4 weeks ago

    Mumbai, India Quantiphi Full time

    Role: Technical Architect - DataExperience Level: 10 to 15 YearsWork location: Mumbai, Bangalore, Trivandrum (Hybrid)Notice Period: AnyRole & Responsibilities:More than 8 years of experience in Technical, Solutioning, and Analytical roles.5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business...

  • Technical Architect

    1 month ago

    Mumbai, India Squareroot Consulting Pvt Ltd. Full time

    We are Series C funded Technology Product Company disrupting Indian & Global market. We intends to replace many legacy systems in use by banks for processing payments. We build large-scale transaction processing systems that can work with many current and future payment networks. We build applications that help banks realise the value of this new approach...

  • Data Architect

    4 weeks ago

    Navi Mumbai, Maharashtra, India Reserve Bank Information Technology Private Limited (ReBIT) Full time

    **Job Title**: Data Architect **Reporting Structure**: Project Manager **Education**: Bachelor’s degree in engineering (CS, IT or equivalent) **Experience/ Qualifications** Experience: 8-14 years - Hands on experience in relational, dimensional, and analytic experience (using RDBMS, dimensional, NoSQL data platform technologies, and ETL and data...

  • Architect : Big Data

    6 days ago

    Mumbai, India Databricks Full time

    As aSolutions Architect(Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be atechnical advisorinternally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Enterprise Solutions Architect

    4 weeks ago

    Mumbai, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Big Data Architect

    4 weeks ago

    Mumbai, Maharashtra, India Robosoft Technologies Full time

    Job Description: At Robosoft, we're passionate about building solutions that solves problems. We count on Big Data Architects who are primary helping us design large data solution from high level to low level keeping cost and performance in consideration. Our customers look for solution which can help them build intelligent analytical platform and support...

  • Principal Architect

    1 month ago

    Mumbai, India Quantiphi Full time

    While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...

  • Technical Architect

    4 weeks ago

    Bangalore/Mumbai, Maharashtra, India Squareroot Consulting Pvt Ltd. Full time

    We are Series C funded Technology Product Company disrupting Indian & Global market. We intends to replace many legacy systems in use by banks for processing payments. We build large-scale transaction processing systems that can work with many current and future payment networks. We build applications that help banks realise the value of this new approach...

  • Technical Architect

    1 month ago

    Bangalore,Mumbai, India Squareroot Consulting Pvt Ltd. Full time

    We are Series C funded Technology Product Company disrupting Indian & Global market. We intends to replace many legacy systems in use by banks for processing payments. We build large-scale transaction processing systems that can work with many current and future payment networks. We build applications that help banks realise the value of this new approach...

  • Gen AI Architect

    1 month ago

    Mumbai, Maharashtra, India Cognizant Technology Solutions Full time

    Job Title : Gen AI ArchitectExp: 14 to 18 yrs Location : Pan India As a Gen AI Architect (General Artificial Intelligence Architect), your primary role is to design and develop artificial intelligence systems that have the capability to learn, reason, and make decisions autonomously. You will oversee the architecture and infrastructure required to build and...

  • Senior Data Engineer

    7 days ago

    Mumbai, India AMINA Bank Full time

    About AMINAAMINA India is a wholly owned subsidiary of AMINA Bank AG, a licensed Swiss Bank focused on cryptocurrencies and digital assets. AMINA provides custody, trading, credit and investment products on cryptocurrencies and digital assets to institutional and professional investors. AMINA Bank is Headquartered in Zug, with presence in Mumbai, Abu Dhabi,...

  • Senior Data Engineer

    7 days ago

    Mumbai, India AMINA Bank Full time

    About AMINAAMINA India is a wholly owned subsidiary of AMINA Bank AG, a licensed Swiss Bank focused on cryptocurrencies and digital assets. AMINA provides custody, trading, credit and investment products on cryptocurrencies and digital assets to institutional and professional investors. AMINA Bank is Headquartered in Zug, with presence in Mumbai, Abu Dhabi,...

  • Architect - Data Engineer

    1 month ago

    Mumbai, India Quantiphi Full time

    Role: Technical Architect - Data Experience Level: 10 to 15 Years Work location: Mumbai, Bangalore, Trivandrum (Hybrid) Notice Period: Any Role & Responsibilities: More than 8 years of experience in Technical, Solutioning, and Analytical roles. 5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration...

  • Architect - Data Engineer

    1 month ago

    Mumbai, India Quantiphi Full time

    Role: Technical Architect - DataExperience Level: 10 to 15 YearsWork location: Mumbai, Bangalore, Trivandrum (Hybrid)Notice Period: AnyRole & Responsibilities:More than 8 years of experience in Technical, Solutioning, and Analytical roles.5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business...