Infocepts - Senior Data Engineer - AWS

1 week ago

Pune, Maharashtra, India InfoCepts Technologies Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 24,00,000 per year

Description :

- Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.

- Should be able to design complex Big Data use cases using AWS Services and Databricks, under guidance of Architect.

- Should be able to assist the architect in reasoning about various architecture choices in terms of cost, performance and durability.

- Should be able to suggest optimizations in existing designs.

- Project documentation adheres to quality guidelines & schedules.

- Works hand in hand with Architect & PM for successful delivery of project and provide estimation, scoping, scheduling assistance.

- Articulate design decisions very clearly with stakeholders.

- Perform Proof-of-Concepts and document all observations before proposing a new solution.

- Conduct design review sessions with other teams and identify scope of improvement.

- Suggests automation to improve existing processes.

Work and Technical Experience :

Must-Have :

- In-depth knowledge of the following AWS services : S3, EC2, EMR, Athena, AWS Glue, Lambda.

- Experience with at least one MPP database : AWS Redshift, Snowflake, SingleStore.

- Proficiency in Big Data technologies : Apache Spark, Databricks.

- Must have strong programming skills in Python.

- Responsible for building data pipelines in AWS And Databricks.

- Experience with Big Data table formats, such as Delta Lake (open source).

- Must have very strong SQL skills.

- Experience with orchestration tools like Apache Airflow.

- Expertise in developing ETL workflows with complex transformations such as SCD, deduplications, aggregations, etc.

- Should be a quick and self-learner, ready to adapt to new AWS services or Big Data technologies as required.

- Strong understanding of data warehousing concepts.

Good to have :

- Cloud Databases - Snowflake, AWS Aurora.

- Big Data - Hadoop, Hive.

- Cloud Databases- AWS Aurora.

- Associate Level or Professional Level AWS Certification or Databricks Certification.

Qualifications :

- Overall, 7 years of IT Exp.

years of relevant experience in AWS related project.

- Bachelors degree in computer science, engineering, or related field (master's degree is a plus).

- Demonstrated continued learning through one or more technical certifications or related methods.

Qualities :

- Hold strong technical knowledge and experience.

- Should have the capability to deep dive and research in various technical related fields.

- Self-motivated and focused on delivering outcomes for a fast-growing team and firm.

- Able to communicate persuasively through speaking, writing, and client presentations.

- Able to consult, write, and present persuasively.

- Able to work in a self-organized and cross-functional team.

- Able to iterate based on new information, peer reviews, and feedback.

- Prior experience of working in a large media company would be added advantage.

  • Infocepts - Senior Data Engineer - Azure Databricks

    2 days ago

    Pune, Maharashtra, India InfoCepts Technologies Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Key Responsibilities : Data Pipeline Development : - Design and implement robust batch and real-time streaming data pipelines leveraging Azure Databricks and Apache Spark. - Build scalable and maintainable ETL/ELT workflows to support data ingestion, transformation, and integration from diverse sources. Data Architecture Implementation :...

  • AWS Data Engineer

    4 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior AWS Data EngineerOverview:We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages.Exp- 3 to 7 years Location- Bangalore, Pune, Hyderabad,...

  • Data Engineer- Databricks

    2 days ago

    Pune, Maharashtra, India InfoCepts Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Infocepts - Business Analyst - Fashion Retail Domain

    2 days ago

    Pune, Maharashtra, India InfoCepts Technologies Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : Job Title : Business Analyst (Luxury Fashion Retail Domain)Purpose of the Position : This position involves performing feasibility and impact assessments, reviewing documentation to ensure conformity to methods, designs, and standards, and achieving economies of scale during the support phase. As a senior Business Analyst you will also...

  • Infocepts - Microstrategy Developer - SQL

    1 day ago

    Pune, Maharashtra, India InfoCepts Technologies Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Description : Role : MicroStrategy Developer. Purpose of the Position : This role is to help our end clients build sustainable reporting, analytic and data solutions to meet business needs, create business value and drive outcomes. Solutions will be designed, developed, and implemented utilizing enterprise technologies including MicroStrategy with...

  • AWS Data Engineer

    7 days ago

    Pune, Maharashtra, India NCSI Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: AWS Data Engineer Company Name: NCSi Job Description: NCSi is seeking a skilled AWS Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing and building robust data pipelines, developing data integration processes, and optimizing database performance in cloud environments. You will work collaboratively with...

  • AWS Data Engineer

    7 days ago

    Pune, Maharashtra, India NCS Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: AWS Data EngineerCompany Name: NCSiJob Description:NCSi is seeking a skilled AWS Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing and building robust data pipelines, developing data integration processes, and optimizing database performance in cloud environments. You will work collaboratively with data...

  • Senior Data Engineer

    2 days ago

    Pune, Maharashtra, India Cortex Consultants Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title: Senior Data Engineer (Snowflake, Azure/AWS, Hadoop, Hive, Python, Databases) Experience: 5 to 8 years Location: Pune and Chennai, India Job Description: We are seeking an experienced and talented Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data...

  • AWS Data Engineer

    1 day ago

    Pune, Maharashtra, India Intineri Infosol Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Title: AWS Data Engineer – Oil & Gas DomainLocation: Offshore/ REMOTEExperience: 4+ years Employment Type: Full time ContractExperienced AWS Data Engineer with Oil & Gas industry expertise to design, build, and optimize scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering...

  • AWS Data Engineer

    7 days ago

    Pune, Maharashtra, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Company: QAP Software SolutionsPosition: AWS Data EngineerLocation: Pune, India (Onsite)Experience: 5–7 YearsStart Date: Immediate / As early as possibleShift Timing: UK Shift (1 PM – 10 PM IST)Role OverviewWe are seeking an experienced AWS Data Engineer with 5–7 years of relevant experience to join our team on a contract basis. The ideal candidate...