Infinite Computer Solutions

1 month ago

BangaloreChennaiHyderabad, India Infinite Computer Solutions Full time

Job Description :

As a DevOps Engineer with AWS expertise, you will play a crucial role in designing, implementing, and optimizing data pipelines on AWS infrastructure using Databricks.

You will work closely with cross-functional teams to ensure the efficient management of data workflows, from ingestion to processing and integration, while adhering to security and compliance standards.

Key Responsibilities :

Developing Data Pipelines :

- Designing and implementing scalable data pipelines using Databricks on AWS infrastructure leveraging Python and Spark.

Data Ingestion :

- Managing the ingestion of structured and unstructured data from various sources into Databricks clusters on AWS, ensuring data quality and reliability.

Data Processing:

- Performing data processing tasks, including transformation, cleansing, aggregation, and enrichment, using Databricks tools and AWS services like EMR (Elastic MapReduce).

Optimization and Performance Tuning :

- Optimizing Databricks jobs and clusters for performance, efficiency, and cost-effectiveness on the AWS platform.

Integration :

- Integrating Databricks with other AWS services such as S3, Glue, Redshift, and Lambda to build end-to-end data solutions.

Monitoring and Maintenance :

- Monitoring Databricks clusters, jobs, and workflows for performance issues, troubleshooting errors, and ensuring high availability and reliability.

Security and Compliance :

- Implementing security best practices and ensuring compliance with data privacy regulations (e.g., GDPR, CCPA) in Databricks deployments on AWS.

Collaboration :

- Collaborating with data engineers, data scientists, and other stakeholders to understand data requirements and deliver solutions that meet business needs.

Documentation :

- Documenting Databricks workflows, architecture, and best practices to facilitate knowledge sharing and maintain system documentation.

Continuous Learning :

- Keeping up-to-date with the latest advancements in Databricks, AWS services, and data engineering technologies to continuously improve skills and contribute to innovation in data solutions.

Qualifications and Skills :

- Bachelor's degree in Computer Science, Engineering, or related field.

- 4+ years of hands-on experience in DevOps, particularly with AWS.

- Proficiency in Python and Spark for developing data pipelines.

- Experience with Databricks, EMR, S3, Glue, Redshift, Lambda, and other AWS services.

- Strong understanding of security best practices and compliance standards.

- Excellent collaboration and communication skills.

- Ability to work effectively in a fast-paced, dynamic environment.

- Continuous learning mindset with a passion for innovation.

Location: Bangalore, Chennai, Hyderabad

(ref:hirist.tech)

  • Infinite Computer Solutions

    3 weeks ago

    Bangalore, India Infinite Computer Solutions Full time

    About Infinite : With over two decades of hands-on experience in cutting-edge technologies and platforms, we at Infinite assist our customers from various industries in optimizing, modernizing, and scaling their technology landscape. Our 10000+ employees working across 20+ global locations constantly strive towards delivering a seamless digital...

  • Infinite Computer Solutions

    2 months ago

    Bangalore, Karnataka, India Infinite Computer Solutions Full time

    About Infinite : With over two decades of hands-on experience in cutting-edge technologies and platforms, we at Infinite assist our customers from various industries in optimizing, modernizing, and scaling their technology landscape. Our 10000+ employees working across 20+ global locations constantly strive towards delivering a seamless digital...

  • Infinite Computer Solutions

    2 months ago

    bangalore, India Infinite Computer Solutions Full time

    About Infinite : With over two decades of hands-on experience in cutting-edge technologies and platforms, we at Infinite assist our customers from various industries in optimizing, modernizing, and scaling their technology landscape. Our 10000+ employees working across 20+ global locations constantly strive towards delivering a seamless digital...

  • Infinite Computer Solutions

    2 months ago

    Bangalore, India Infinite Computer Solutions Full time

    About Infinite : With over two decades of hands-on experience in cutting-edge technologies and platforms, we at Infinite assist our customers from various industries in optimizing, modernizing, and scaling their technology landscape. Our 10000+ employees working across 20+ global locations constantly strive towards delivering a seamless digital...

  • Infinite Computer Solutions

    3 weeks ago

    Bangalore, Karnataka, India Infinite Computer Solutions Full time

    About Infinite : With over two decades of hands-on experience in cutting-edge technologies and platforms, we at Infinite assist our customers from various industries in optimizing, modernizing, and scaling their technology landscape. Our 10000+ employees working across 20+ global locations constantly strive towards delivering a seamless digital...

  • Infinite Computer Solutions

    2 months ago

    bangalore, India Infinite Computer Solutions Full time

    Role : Data, AI & Analytics Practice ArchitectResponsibilities : - Lead the creation & evolution of Infinite's data & AI practice under the guidance of the Practice head with BU data science, engineering & architecture teams.- Build & maintain core data, AI, and Analytics platform competencies with high automation & ease of use by data scientists &...

  • Infinite Computer Solutions

    3 weeks ago

    Bangalore/Chennai/Hyderabad, India Infinite Computer Solutions Full time

    Job Description :As a Databricks Architect with expertise in AWS, you will be responsible for designing and implementing end-to-end data solutions architecture on AWS leveraging Databricks capabilities. You will lead the planning, implementation, optimization, and governance of Databricks deployments on AWS, ensuring scalability, reliability, and performance...

  • Infinite Computer Solutions

    1 month ago

    Bangalore/Chennai/Hyderabad, IN Infinite Computer Solutions Full time

    Job Description :As a Databricks Architect with expertise in AWS, you will be responsible for designing and implementing end-to-end data solutions architecture on AWS leveraging Databricks capabilities. You will lead the planning, implementation, optimization, and governance of Databricks deployments on AWS, ensuring scalability, reliability, and performance...

  • Infinite Computer Solutions

    1 month ago

    Bangalore/Chennai/Hyderabad, India Infinite Computer Solutions Full time

    Job Description :As a Databricks Architect with expertise in AWS, you will be responsible for designing and implementing end-to-end data solutions architecture on AWS leveraging Databricks capabilities. You will lead the planning, implementation, optimization, and governance of Databricks deployments on AWS, ensuring scalability, reliability, and performance...

  • Infinite Computer Solutions

    3 weeks ago

    Bangalore/Chennai/Hyderabad, IN Infinite Computer Solutions Full time

    Job Description :As a Databricks Architect with expertise in AWS, you will be responsible for designing and implementing end-to-end data solutions architecture on AWS leveraging Databricks capabilities. You will lead the planning, implementation, optimization, and governance of Databricks deployments on AWS, ensuring scalability, reliability, and performance...

  • Infinite Computer Solutions

    2 months ago

    Bangalore, Karnataka, India Infinite Computer Solutions Full time

    Role : Data, AI & Analytics Practice ArchitectResponsibilities :- Lead the creation & evolution of Infinite's data & AI practice under the guidance of the Practice head with BU data science, engineering & architecture teams.- Build & maintain core data, AI, and Analytics platform competencies with high automation & ease of use by data scientists &...

  • Infinite Computer Solutions

    2 months ago

    Bangalore, India Infinite Computer Solutions Full time

    Role : Data, AI & Analytics Practice ArchitectResponsibilities : - Lead the creation & evolution of Infinite's data & AI practice under the guidance of the Practice head with BU data science, engineering & architecture teams.- Build & maintain core data, AI, and Analytics platform competencies with high automation & ease of use by data scientists &...

  • Infinite Computer Solutions

    3 weeks ago

    Bangalore, Karnataka, India Infinite Computer Solutions Full time

    Role : Data, AI & Analytics Practice ArchitectResponsibilities :- Lead the creation & evolution of Infinite's data & AI practice under the guidance of the Practice head with BU data science, engineering & architecture teams.- Build & maintain core data, AI, and Analytics platform competencies with high automation & ease of use by data scientists &...

  • Infinite Computer Solutions

    1 month ago

    Bangalore/Chennai/Hyderabad, IN Infinite Computer Solutions Full time

    Job Description :As a DevOps Engineer with AWS expertise, you will play a crucial role in designing, implementing, and optimizing data pipelines on AWS infrastructure using Databricks. You will work closely with cross-functional teams to ensure the efficient management of data workflows, from ingestion to processing and integration, while adhering to...

  • Infinite Computer Solutions

    3 weeks ago

    Bangalore/Chennai/Hyderabad, IN Infinite Computer Solutions Full time

    Job Description :As a DevOps Engineer with AWS expertise, you will play a crucial role in designing, implementing, and optimizing data pipelines on AWS infrastructure using Databricks. You will work closely with cross-functional teams to ensure the efficient management of data workflows, from ingestion to processing and integration, while adhering to...

  • Infinite Computer Solutions

    3 weeks ago

    Bangalore, India Infinite Computer Solutions Full time

    About the Role :We are seeking a visionary and highly experienced Technical Director to join our leadership team. In this critical role, you will be responsible for leading and shaping the technical direction of our organization. You will leverage your extensive experience in software development, technology strategy, and team leadership to drive innovation,...

  • Infinite Computer Solutions

    2 months ago

    Bangalore, Karnataka, India Infinite Computer Solutions Full time

    About the Role :We are seeking a visionary and highly experienced Technical Director to join our leadership team. In this critical role, you will be responsible for leading and shaping the technical direction of our organization. You will leverage your extensive experience in software development, technology strategy, and team leadership to drive innovation,...

  • Infinite Computer Solutions

    2 months ago

    Bangalore, India Infinite Computer Solutions Full time

    About the Role :We are seeking a visionary and highly experienced Technical Director to join our leadership team. In this critical role, you will be responsible for leading and shaping the technical direction of our organization. You will leverage your extensive experience in software development, technology strategy, and team leadership to drive innovation,...

  • Infinite Computer Solutions

    3 weeks ago

    Bangalore, Karnataka, India Infinite Computer Solutions Full time

    About the Role :We are seeking a visionary and highly experienced Technical Director to join our leadership team. In this critical role, you will be responsible for leading and shaping the technical direction of our organization. You will leverage your extensive experience in software development, technology strategy, and team leadership to drive innovation,...

  • Infinite Computer Solutions

    1 month ago

    bangalore, India Infinite Computer Solutions Full time

    Job Description :We are seeking a highly skilled and experienced Solution Architect with expertise in Java Back-End development, OTT platforms, Spring Boot, Spring Framework, AWS, DevOps, and Angular (optional but a plus). As a Solution Architect, you will be responsible for designing and overseeing the implementation of complex software solutions that meet...