Data Architect- Aws-big Data

4 days ago

Chennai Tamil Nadu, India InfoCepts Full time

**Position**: Data Architect
- AWS-Big Data

**Purpose of the Position**:
As a Data Architect, you will be responsible for designing and optimizing complex Big Data solutions using AWS services, ensuring a balance between cost and performance. Responsibilities include assessing existing technology, performing impact assessments, optimizing designs, and documenting projects. The role involves effective communication of architectural decisions, conducting Proof-of-Concepts and design solutions, suggesting automation and providing expert advice.

**Location**: Nagpur/Pune/Chennai/Bangalore

**Type of Employment**: Full-time

**Key Result Areas and Activities**:

- **Technology Assessment and Impact Analysis**: Evaluate existing technology and data integration frameworks, and conduct impact assessments based on requirements.
- **Big Data Use Case Design**: Create complex Big Data use cases using AWS services, focusing on cost, performance, and durability.
- **Optimization and Performance**: Recommend optimizations to balance cost and performance in existing designs.
- **Architectural Communication and Proof-of-Concepts**: Communicate architectural decisions to stakeholders, conduct Proof-of-Concepts, document findings, and lead design reviews.
- **Process Improvement and Automation**: Implement automation to improve processes and enhance team productivity, while providing expert advice, troubleshooting, and support for client proposals.

**Essential Skills**:

- Experience of AWS services (S3,EC2, EMR, Athena, AWS Glue, Lambda) and AWS VPC, subnets, security groups, and route tables
- Expertise in MPP databases (AWS Redshift, Snowflake, SingleStore) and Data Warehousing concepts
- Proficient in Big Data technologies, specifically Apache Spark, and table formats like Delta Lake or Apache Iceberg
- Strong programming skills in Scala and Python, along with SQL proficiency and experience with orchestration tools like Apache Airflow
- Skilled in developing ETL workflows with complex transformations (SCD, deduplication, aggregation)
- Proficient in operating systems, including Linux and Windows

**Desirable Skills**:

- Prior experience working in a large media company would be an added advantage. Knowledge of Data Fabric and Data Mesh concepts
- Programming Language: Java, Bash
- Cloud Databases: AWS Aurora

**Qualifications**:

- Bachelor's degree in computer science, engineering, or related field (Master's degree is a plus)
- Demonstrated continued learning through one or more technical certifications or related methods
- 9 years of IT experience with minimum 5 years of experience on cloud-related projects

**Qualities**:

- Hold strong technical knowledge and experience with the capability to deep dive and research in various technical fields
- Self-motivated and focused on delivering outcomes for a fast-growing team and organization
- Able to communicate persuasively through written, verbal and client presentations
- Effective and self-organized in cross-functional team and across different time zones

**Location**

India

**Years Of Exp**

9 to 12 years

  • Big Data Architect

    5 days ago

    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    **Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Data Architect

    4 days ago

    Siruseri, Chennai, Tamil Nadu, India Hub Work Full time

    10+ years experience in architecting, designing, and developing large scale data solutions. 10+ years experience in building and maintaining ETL/ELT pipelines 5 years experience in developing streaming processes / systems Proficiency in various data management concepts such as Master Data Management Data Architecture Data Modeling Data...

  • Data Analytics

    3 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    **Must Have**: - Scripting :Python, Pyspark, Unix scripting (Basic) - Cloud : AWS -Lambda, Glue, Athena,RDS,S3, DynamoDB,SNS, SQS, IAM, Step function, Pipeline monitoring, Security, Access and Role permissions, Logging and monitoring Services. - Database : SQL/Oracle - Tools : Pycham,VishualStudio,AWS CLI - Devops Tools : Terraform ,GIT,GIT actions, CICD...

  • Big Data Architect

    5 days ago

    Chennai, India Cynosure Full time

    Job Information Industry - TelecommunicationsWork Experience - 7-10 yearsCity - ChennaiState/Province - Tamil NaduCountry - IndiaZip/Postal Code - 600018**Responsibilities**: - Articulate business and data requirements from business analysts across the various functional and business areas and then design/manage enterprise big data architecture, data...

  • Data Analytics

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    We are currently seeking a Data Analytics to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). **Must Have** - Scripting :Python, Pyspark, Unix scripting (Basic) - Cloud : AWS -Lambda, Glue, Athena,RDS,S3, DynamoDB,SNS, SQS, IAM, Step function, Pipeline monitoring, Security, Access and Role permissions, Logging and monitoring Services. Database :...

  • Data Architect

    5 days ago

    Chennai, Tamil Nadu, India Kanini Software Solutions Full time

    **Want to join KANINI?** We are looking for someone who has a deep understanding of Big Data and Cloud architecture and is excited to advance innovative analytics solutions. As a Data Architect, you effectively communicate ideas and concepts to peers and bring on board the experience of leading projects that support the organization’s business objectives...

  • Itss-big Data/hadoop/splunk Developer-humjp00032202

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 317271NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a ITSS-Big Data Hadoop Splunk Developer-HUMJP00032202 to join our team in chennai Tamil Nxc4x81du IN-TN India IN ...

  • Big Data Solutions Architect

    3 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data Solutions Architect">About the Role:"We are seeking a highly skilled and experienced Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing complex data solutions using Azure Data Factory, Azure Databricks, and Cosmos DB."""The ideal candidate...

  • Data Solution Architect

    2 days ago

    Chennai, Tamil Nadu, India Gainwell Technologies LLC Full time

    **Summary**: The solution architect will use knowledge of healthcare data to influence the implementation and governance of our data architecture. Your designs will account for data movement, storage, compute and BI consumption, and will comply with security and data governance standards. You will work closely with a variety of partners within the Data and...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility: 2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...