Big Data Architect
2 weeks ago
Job description :
- The decision-making power for data analysis and he/she should also possess the quality of architecting the massive data
- Should have skills in big data tools and technologies; it includes technologies like the Hadoop, accumulo, MapReduce, Hive, HBase, panoply and redshift
- Overall 10 years of experience as Principal Consultant, Subject Mater Expert working on Big Data Platforms (Hadoop, Map Reduce, NoSQL, Real Time Streaming, Search, Spark, Java ETL platforms)
- Experience with managing and handling very large data repositories, delivering distributed and highly scalable applications
- End-to-end design and build process of Near-Real Time and Batch Data Pipelines; expertise with SQL and Data modeling working in Agile development process
Ability to work with large data sets :
- Big Data involves large data sets, so applicants must be able to work with highly diverse data in multiple types and formats, and sources
Self-starter :
- They must be able to work with minimal supervision
- Ability to quickly prototype, architect and build software using latest/greatest technologies
- Good Customer facing, interpersonal and communication skills
- Experience in addressing non-functional requirement s and large application deployment architectures and concerns such as scalability, performance, availability, reliability, security etc
- Experience in any one or more of the following technologies
- Experience on Hadoop (Apache/Cloudera/Hortonworks) and/or other Map Reduce Platforms
- Experience on Hive, Pig, Sqoop, Flume and/or Mahout
- Experience on NO-SQL HBase, Cassandra, MongoDB (Any one NO SQL would do)
- Experience on Spark, Storm, Kafka (Spark and Kafka is a must)
- Experience around Search Platform Solr, Elastic
- Streaming Data load organizing in Hadoop
- Good background of Configuration Management/Ticketing systems like Maven/Ant/JIRA etc.
- Strong in Shell Scripting programming, Java, EDW platforms
- Knowledge around any Data Integration and/or EDW tools is plus
- Extensive experience with Enterprise Messaging framework (Kafka or RabbitMQ)
- Must be able to provide out of the box solutions when ever required.
Preferred Skills : Data Integration, SQL, NO SQL, CLOUDERA , ADVANCED JAVA
Teamwork abilities :
- The big data architect must be able to work in a team-oriented environment with people of diverse skill sets
Analytical skills :
- It is important that big data architects can analyze complex problems using information provided understand customer requests, and provide the appropriate solution
Data warehousing :
- Strong Data warehousing concepts
- Strong Data Modelling skills (analytical models), preferably with ERWin
- Must have implemented end-to-end DWH projects (discovery, requirements gathering,
- HLD/LLD documentation, development, testing, SIT, UAT, deployment, pre and post prod checks etc)
o Must have worked with Teradata / Greenplum / Synapse / Big Query / Snowflake
Data Integration / Data Engineering:
- Strong logical and analytics abilities in DI/DQ
- Very strong skills in writing logical code for data engineering, which has re-usable capabilities without rework
- Strong knowledge and technical expertise in ETL tools such as Talend / Informatica / Datastage / Pentaho etc.
Data Quality:
- Strong understanding and experience in DQ frameworks
- Must have implemented atleast 2 projects involving end-to-end DQ frameworks
- Very strong skills in writing logical code for data quality, which has re-usable capabilities without rework
Good to Have Skills : EDW Tools experience like Teradata, Netezza etc.
Qualifications and Education Requirements :
Any Degree :
Role : Big Data Engineer
Education :
UG : Any Graduate
PG : Any Postgraduate
-
GCP Data Architect
4 weeks ago
Anywhere in India/Multiple Locations, IN Huquo Full timeRole : GCP Data Architect Description : As a GCP Data Architect, you will be responsible for architecting enterprise data solutions for migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable...
-
Big Data Architect
3 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full timeAbout the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...
-
Aptus Data Labs
5 hours ago
Anywhere in India/Multiple Locations, IN Aptus Data Labs Full timeRole - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...
-
Big Data Developer
4 weeks ago
Anywhere in India/Multiple Locations, IN Risk Resources LLP Full timeResponsibilities :- Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP- Define the technical vision and roadmap for big data architecture within the organization- Architect and implement scalable, high-performance big data pipelines using technologies like MapReduce, Hive, Spark, and BigQuery-...
-
Hadoop Administrator
4 weeks ago
Metros/Anywhere in India/Multiple Locations, IN Dotflick Solutions Full timeDesignation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...
-
MDM Architect
4 weeks ago
Anywhere in India/Multiple Locations, IN TELL Jobs Full timeJob Description :- Minimum 8+ years of proven experience and Own and aggressively drive forward MDM, Data Governance, Big Data, and Cloud Data Management- Develops data integration processes using the Informatica platform - Creating business solutions which utilize the CDI platform and ensure high quality and scalable solutions- Work with EA (Enterprise...
-
Lead Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations, IN Grownex HR Solution Full timeRole : Lead Big Data EngineerWork Mode : Remote(5 Days working)The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate...
-
MDM Architect
4 weeks ago
Anywhere in India/Multiple Locations, IN TELL Jobs Full timeJob Description :- Minimum 8+ years of proven experience and Own and aggressively drive forward MDM, Data Governance, Big Data, and Cloud Data Management- Develops data integration processes using the Informatica platform (eg- Creating business solutions which utilize the CDI platform and ensure high quality and scalable solutions- Work with EA (Enterprise...
-
ETL Developer
4 weeks ago
Anywhere in India/Multiple Locations, IN Dotflick Solutions Full timeJob Designation : ETL DeveloperWFH / WFOJob Description :- Work Experience : Overall 3+ years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting solutions with relevant experience.Role & Responsibilities :- To be a Data expert/Architect in implementing solutions using Databases/ETL/DWH/Data Integration/Reporting tools with...
-
PySpark Tech Lead
4 weeks ago
Anywhere in India/Multiple Locations, IN TD Newton & Associates Full timeTechnical Skills :- Extensive experience working on software engineering projects and SDLC- Have worked on various development project as developer and/or lead developer.- Capability to understand and comprehend the solution and create a development framework where all the developers will be contributing.- Should be able to create a Test driven development...
-
Cloud Data Architect
4 weeks ago
Anywhere in India/Multiple Locations, IN LIVE CONNECTIONS PLACEMENTS PRIVATE LIMITED Full timeJob Description : Cloud Data ArchitectWe are seeking a highly skilled Cloud Data Architect with extensive experience in managing the complete data landscape, including data ingestion, transformation, processing, and consumption. The ideal candidate will have a strong background in program management and technical governance, along with deep expertise in data...
-
Big Data Quality Assurance Engineer
4 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Leadway Resource Full timeWe are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...
-
Data Platform Architect
1 week ago
Bangalore/Anywhere in India/Multiple Locations, IN Grizmo Labs Full timeResponsibilities :- Design and architect data platforms to support the storage, processing, and analysis of large-scale datasets exceeding 25 TB.- Develop strategies for data management, integration, and governance to ensure data quality and security.- Collaborate with cross-functional teams to understand business requirements and translate them into...
-
Valiance Solutions
4 weeks ago
Anywhere in India/Multiple Locations, IN Valiance Analytics Pvt. Ltd. Full timeAbout Us :Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...
-
Sigmoid Analytics
4 weeks ago
Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full timeThis position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...
-
Data Architect
4 weeks ago
Pune/Hyderabad/Anywhere in India/Multiple Locations, IN Huquo Full timeJob Description :- SQL, Python and Java , Data Modelling, Hadoop Platform, Cloud Platform(GCP preferable)- Developing and implementing an overall organisational data strategy that is in line with business processes.- The strategy includes data model designs, database development standards, implementation and management of data warehouses and data analytics...
-
Sigmoid Analytics
4 weeks ago
Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full timeJob Description :This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...
-
Senior Data Architect
4 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full timeAbout the Role :We are seeking a highly experienced and visionary Senior Data Architect to join our growing data team. You will be responsible for leading the design, development, and implementation of our enterprise data architecture. You will play a critical role in defining and implementing strategies to ensure our data infrastructure is scalable, secure,...
-
Big Data Engineer
4 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Connectio IT Pvt Ltd Full timeKey Skills : Java, Apache Spark, Apache Kafka, Hadoop, AWSJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for existing...
-
Data Engineer
4 weeks ago
Pune/Hyderabad/Anywhere in India/Multiple Locations, IN Huquo Full timeBasic understanding of :- Scheduling and workflow management & working experience in either ADF, Informatica, Airflow, or Similar- Enterprise Data Modelling and Semantic Modelling & working experience in ERwin, ER/Studio, PowerDesigner, or Similar- Logical/Physical model on Big Data sets or modern data warehouse & working experience in ERwin, ER/Studio,...