Big Data Specialist

3 weeks ago


thane, India Taggd Full time

Job Description

Position: Senior Cloud Data Engineer – AWS

Location: Nagpur/Pune/Chennai/Bangalore

Experience: 7 to 9 years

Notice Period: 30 Days

Travel: NA

Type of Employment: Full-time

Key Result Areas and Activities:


  • Share and Build Expertise- Develop and share expertise in AWS and Python and actively mine the experience and expertise in the organization for sharing across teams and clients in the firm. Support the Cloud and Data Engineering COE initiatives
  • Data Pipeline Development and Optimization: Design, develop, and optimize scalable ETL/ELT pipelines using AWS services such as Glue, Lambda, and Step Functions to manage large-scale data processing.
  • Data Storage and Management: Implement and manage data storage solutions like S3, Redshift, and RDS, ensuring optimal performance, cost efficiency, and compliance with data governance standards.
  • Cloud Infrastructure and Security Management: Architect and manage cloud infrastructure using AWS services such as CloudFormation, EC2, and IAM, ensuring security, reliability, and scalability of data systems.
  • Monitoring, Maintenance, and Troubleshooting: Set up monitoring and alerting systems using CloudWatch, AWS Config, and other tools to ensure system health, troubleshoot issues, and maintain high availability.
  • Collaboration and Stakeholder Communication: Collaborate with cross-functional teams, including data analysts and business stakeholders, to understand requirements, provide technical solutions, and ensure data architecture aligns with business goals.

Must have:

  • Expertise in AWS services like S3, EC2, EMR, Lambda, Glue, and Redshift.
  • Strong knowledge of cloud databases such as Aurora, Snowflake, and Singlestore.
  • Proficient in big data tools like Hadoop, Hive, Spark, and programming languages such as Scala, Python, and PySpark.
  • Advanced SQL skills with experience in developing complex ETL workflows, including SCD, deduplication, and aggregation.
  • Hands-on experience with orchestration tools like Apache Airflow.
  • Thorough understanding of AWS VPC, subnets, security groups, and route tables.

Qualifications:

  • Minimum 7+ years of IT experience with 3+ years of AWS related projects.
  • Bachelor’s degree in computer science, engineering, or related field (master’s degree is a plus)
  • Demonstrated continued learning through one or more technical certifications or related methods

Qualities:

  • Should have the capability to deep dive and research in various technical related fields
  • Self-motivated and focused on delivering outcomes for a fast-growing team and firm
  • Able to communicate persuasively through speaking, writing, and client presentations
  • Able to work in a self-organized and cross-functional team


  • Data Specialist

    2 weeks ago


    Thane, India WebBuddy Full time

    Company Description At WebBuddy, we are a web design and development agency committed to being a trusted partner in shaping online presence. Our team of expert developers, creative designers, and strategic thinkers strive to transform ideas into digital realities for clients globally. With a focus on delivering top-notch, customized web solutions that drive...


  • Thane, India BestoSEO Full time

    Company DescriptionBestoSEO is a Digital Marketing company located in Thane, specializing in designing and building brand solutions to enhance organizations' digital presence on social media and search engines. We prioritize creativity, customer-centric strategies, and maximizing customer engagement to improve ROI.Role DescriptionThis is a full-time on-site...


  • Maharashtra/Gujarat/Ahmedabad/Mumbai/Thane/Navi Mumbai/Nasik/Nagpur/Pune/Aurangabad/Vadodara/Baroda/, India Aricent Full time

    **Job Description : **At Aricent, we are seeking a skilled Data Integration Specialist to join our team. As a Data Integration Specialist, you will be responsible for designing, developing, and implementing data extraction, transformation, and loading (ETL) processes.**Key Responsibilities : *** Design and develop ETL processes to extract data from various...


  • Thane, India AdEngage Full time

    We are looking for a skilled and experienced Human Resources Specialist to join our team! As a Human Resources Specialist, you will be responsible for supporting our HR department in the development and execution of HR strategy, policies and objectives.Managing all HR proceduresIdentifying companys hiring needs and managing the recruitment processConducting...


  • Thane, India Applicantz Full time

    THIS IS A LONG TERM CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER. Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and a Flexible work environment. They use cutting-edge technologies to keep themselves ahead of the curve. Diversity in all...


  • Thane, India search syerngy Full time

    Vacancy for Senior Infrastructure SpecialistWe are seeking an experienced Data Center Operations Engineer to join our team at search syerngy. The ideal candidate will have a strong background in developing Data Center Operations and Support Functions, with a minimum of 10 years of experience. Additionally, the candidate should have at least 4 years of...


  • Thane, India BestoSEO Full time

    Company DescriptionBestoSEO is a Digital Marketing company located in Thane, specializing in designing and building brand solutions to enhance organizations' digital presence on social media and search engines. We prioritize creativity, customer-centric strategies, and maximizing customer engagement to improve ROI.Role DescriptionThis is a full-time on-site...


  • thane, India BestoSEO Full time

    Company Description BestoSEO is a Digital Marketing company located in Thane, specializing in designing and building brand solutions to enhance organizations' digital presence on social media and search engines. We prioritize creativity, customer-centric strategies, and maximizing customer engagement to improve ROI. Role Description This is a full-time...

  • Data Science Trainer

    2 months ago


    Kopri, Thane, Maharashtra, India DPMI Institute Full time

    **Key Responsibilities**: - Develop and deliver data science course content (lectures, assignments, projects, etc.) for online and offline classes. - Teach essential data science concepts such as data wrangling, machine learning, statistical analysis, data visualization, and big data tools. - Guide students through practical projects, coding exercises, and...


  • Thane, India Consultancy Full time

    About the Role:We are seeking a highly skilled Cybersecurity Specialist to join our team at Consultancy. As an Information Security Engineer, you will play a critical role in ensuring the security and integrity of our systems and data.Key Responsibilities:Develop and implement security policies, standards, and procedures to protect our systems and...


  • thane, India Aditya Birla Group Full time

    This position is based at our client (part of the Aditya Birla Group) at their Shared Services NOC at Thane . This is on a Third Party payroll **Job Title: L1 Network Specialist** Job Description for Network Technical Specialist The Network Technical Specialist will be responsible for the design, implementation, and maintenance of a reliable, secure, and...


  • Thane, India Aditya Birla Group Full time

    This position is based at our client (part of the Aditya Birla Group) at their Shared Services NOC at Thane . This is on a Third Party payroll **Job Title: L1 Network Specialist** Job Description for Network Technical Specialist The Network Technical Specialist will be responsible for the design, implementation, and maintenance of a reliable, secure, and...


  • Thane, India Aditya Birla Group Full time

    This position is based at our client (part of the Aditya Birla Group) at their Shared Services NOC at Thane . This is on a Third Party payroll **Job Title: L1 Network Specialist** Job Description for Network Technical Specialist The Network Technical Specialist will be responsible for the design, implementation, and maintenance of a reliable, secure,...


  • Thane, India Aditya Birla Group Full time

    This position is based at our client (part of the Aditya Birla Group) at their Shared Services NOC at Thane . This is on a Third Party payroll**Job Title: L1 Network Specialist**Job Description for Network Technical SpecialistThe Network Technical Specialist will be responsible for the design, implementation, and maintenance of a reliable, secure, and...


  • Thane, India Aditya Birla Group Full time

    This position is based at our client (part of the Aditya Birla Group) at their Shared Services NOC at Thane . This is on a Third Party payroll **Job Title: L1 Network Specialist** Job Description for Network Technical Specialist The Network Technical Specialist will be responsible for the design, implementation, and maintenance of a reliable, secure,...

  • Azure Data Engineer

    2 weeks ago


    thane, India Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will:Implement continuous improvements to our data governance practices and implement data quality improvements.Partner with key stakeholders to understand and refine data product requirements.Design and develop reliable data product pipelines that transform data at scale, orchestrated via Azure Data Factory,...


  • Thane, India SS Consultancy Services Full time

    About the RoleSS Consultancy Services is seeking a highly skilled Information Systems Security Specialist to join our team. As an Information Systems Security Specialist, you will be responsible for ensuring the security and integrity of our information systems.Key ResponsibilitiesConduct comprehensive audits of our information systems, applications, and IT...


  • Thane, India Primesoft Full time

    Database Developer PositionWe are seeking a skilled Senior SQL Database Specialist to join Primesoft. As an SQL Database Specialist, you will be responsible for understanding the current database design, table structures, writing SQL queries, stored procedures, and optimizing the queries. You will collaborate with our software development team to ensure...


  • Thane, India search syerngy Full time

    Data Center Operations EngineerWe are seeking a highly skilled Data Center Operations Engineer to join our team. As a key member of our infrastructure team, you will be responsible for designing, implementing, and managing our data center infrastructure to ensure high availability, scalability, and performance.Key Responsibilities:Develop and implement data...


  • Thane, India Lifelancer Full time

    APIbased data processing Content Builder Marketing Automation and CRM Integration Salesforce Marketing Cloud SFDC SFMC Automation Studio SFMC Email Studio SFMC Journey BuilderRoles and Responsibilities : Translate HCP journeys designed by Marketing into Salesforce Marketing Cloud languageAccountability of endtoend HCP journey design and implementation...