BigData Architect

4 weeks ago


Hyderabad Secunderabad Telangana, India GSPANN Technologies Full time
Role:  BigData Architect
Experience 6+ years
Location Hyderabad

Responsibilities
  • Participate in design architecture, support projects, review information elements, including models, glossary, flows, and data usage.
  • Provide guidance to the team in achieving the project goals/milestones.
  • Contribute to multiple delivery teams, define best practices, build reusable components, build capability, align industry trends, and actively engage with wider data communities.
  • Build real-time and batch ETL/ELT solutions using open-source technology like Spark/Flink/Storm/Kafka streaming.
  • Create a data model (ER and Dimension model) to help data consumers create a high-performance consumption layer.
  • Investigate new technologies, data modeling methods, and information management systems to determine which ones should be incorporated into data architecture and develop implementation timelines and milestones.
  • Create or support production software/systems by identifying and resolving performance bottlenecks for production systems.
  • Run multiple projects simultaneously following both waterfall and Agile methodologies.
  • Maintain data quality by introducing data governance/validation framework.
Required Skill
  • Prior experience in database concepts like Online Transaction Processing (OLTP), Online Analytical Processing (OLAP), Start and Snowflake Schema, Normalization and Demoralization, etc.
  • Expertise in SAP, Talend, and Apache Nifi will be advantageous.
  • Familiar with open-source workflow management software like Airflow/Oozie.
  • Hands-on in managing the Engineering team and own Architecture best practices.
  • Excellent coding experience in Big Data technologies like Hadoop, KAFKA, Hive, Spark , Flink, Storm, etc.
  • Experience in any two of the cloud services - GCP/AWS/Azure.
  • Good understanding of cloud data lake implementation, preferably GCP.
  • Expert in Python and SQL.


  • hyderabad, India State Street Full time

    Job Title Oracle Bigdata Delivery Lead - Assistant Vice President Role Summary & Role Description Delivery Lead with Oracle SQL,PLSQL, Performance tuning and Hadoop stack - Impala , Hive, HBase, Spark, Sqoop Expected to spend 80% of the time on hands-on development, design and architecture and remaining 20% on guiding the team on technology...


  • Hyderabad, India State Street Full time

    Job Title Oracle Bigdata Delivery Lead - Assistant Vice President Role Summary & Role Description Delivery Lead with Oracle SQL,PLSQL, Performance tuning and Hadoop stack - Impala , Hive, HBase, Spark, Sqoop Expected to spend 80% of the time on hands-on development, design and architecture and remaining 20% on guiding the team on technology and...


  • Hyderabad, India State Street Full time

    Job TitleOracle Bigdata Delivery Lead - Assistant Vice PresidentRole Summary & Role DescriptionDelivery Lead with Oracle SQL,PLSQL, Performance tuning and Hadoop stack - Impala , Hive, HBase, Spark, SqoopExpected to spend 80% of the time on hands-on development, design and architecture and remaining 20% on guiding the team on technology and removing other...


  • Hyderabad, India Chryselys Full time

    Senior AWS Backend Developer.Key Responsibilities:- Design and Implement AWS-Based Solutions: Develop advanced applications using a range of AWS services including Lambda, EC2, S3, Glue, DynamoDB, and Redis, with a strong emphasis on leveraging AWS for AI or BIgData applications.- Expertise in AWS Data Services: Utilize AWS data services such as S3 Data...


  • Pune,Hyderabad,Gurgaon,Gurugram, India HuQuo Full time

    Data Architect/Data Modeler Role :- Data Modeling, Enterprise Data Warehouses(Structured and Unstructured data) , Relational Databases, ETL , Big Data, Cloud platforms.- Experienced in multiple domains like Financial domain (Royal Bank Of Scotland, NatWest), US Healthcare(United Health Group).- Hands-on experience in end to end life cycle of Enterprise Data...


  • Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    Data Architect/Data Modeler Role :- Data Modeling, Enterprise Data Warehouses(Structured and Unstructured data) , Relational Databases, ETL , Big Data, Cloud platforms.- Experienced in multiple domains like Financial domain (Royal Bank Of Scotland, NatWest), US Healthcare(United Health Group).- Hands-on experience in end to end life cycle of Enterprise Data...


  • Hyderabad, India Splunk Inc Full time

    Join us as we pursue our ground-breaking vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we are committed to our work, customers, having fun, and most significantly to each other’s...


  • Hyderabad, India Chryselys Full time

    Senior AWS Backend Developer. Key Responsibilities:Design and Implement AWS-Based Solutions: Develop advanced applications using a range of AWS services including Lambda, EC2, S3, Glue, DynamoDB, and Redis, with a strong emphasis on leveraging AWS for AI or BIgData applications.Expertise in AWS Data Services: Utilize AWS data services such as S3 Data Lake,...


  • Hyderabad, India Chryselys Full time

    Senior AWS Backend Developer . Key Responsibilities: Design and Implement AWS-Based Solutions: Develop advanced applications using a range of AWS services including Lambda, EC2, S3, Glue, DynamoDB, and Redis, with a strong emphasis on leveraging AWS for AI or BIgData applications. Expertise in AWS Data Services: Utilize AWS data services such as S3 Data...


  • Hyderabad, India Chryselys Full time

    Senior AWS Backend Developer. Key Responsibilities:Design and Implement AWS-Based Solutions: Develop advanced applications using a range of AWS services including Lambda, EC2, S3, Glue, DynamoDB, and Redis, with a strong emphasis on leveraging AWS for AI or BIgData applications.Expertise in AWS Data Services: Utilize AWS data services such as S3 Data Lake,...


  • Hyderabad, India Splunk Inc Full time

    Join us as we pursue our ground-breaking vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we are committed to our work, customers, having fun, and most significantly to each other’s...


  • hyderabad, India Splunk Inc Full time

    Join us as we pursue our ground-breaking vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we are committed to our work, customers, having fun, and most significantly to each other’s...


  • Hyderabad, India Splunk Inc Full time

    Join us as we pursue our ground-breaking vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we are committed to our work, customers, having fun, and most significantly to each other’s...


  • Hyderabad, India Splunk Inc Full time

    Join us as we pursue our ground-breaking vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we are committed to our work, customers, having fun, and most significantly to each other’s...


  • hyderabad, India Splunk Inc Full time

    Join us as we pursue our ground-breaking vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we are committed to our work, customers, having fun, and most significantly to each other’s...


  • hyderabad, India Splunk Inc Full time

    Job Description Join us as we pursue our ground-breaking vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we are committed to our work, customers, having fun, and most significantly to...


  • hyderabad, India Splunk Inc Full time

    Join us as we pursue our ground-breaking vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we are committed to our work, customers, having fun, and most significantly to each other’s...


  • Hyderabad, India Deloitte Full time

    What impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you will find unrivaled opportunities to succeed and realize your full potentialDeloitte is where you will find unrivaled...


  • Hyderabad, India Goldman Sachs Full time

    What We DoAt Goldman Sachs, our Engineers don’t just make things – we make things possible. Change the world by connecting people and capital with ideas. Solve the most challenging and pressing engineering problems for our clients. Join our engineering teams that build massively scalable software and systems, architect low latency infrastructure...


  • Hyderabad, India Goldman Sachs Full time

    What We DoAt Goldman Sachs, our Engineers don’t just make things – we make things possible. Change the world by connecting people and capital with ideas. Solve the most challenging and pressing engineering problems for our clients. Join our engineering teams that build massively scalable software and systems, architect low latency infrastructure...