Data Engineer

2 weeks ago

Bengaluru, Karnataka, India O2F Info Solutions Pvt. Ltd. Full time

Job Summary :

We are seeking a highly skilled Senior Data Engineer with 4 to 8 years of experience in building robust data pipelines and working extensively with PySpark to join our data engineering team.

Key Responsibilities :

Data Pipeline Development :

- Design, build, and maintain scalable data pipelines using PySpark to process large datasets and support data-driven applications and analytics.

ETL Process Automation :

- Develop and automate ETL (Extract, Transform, Load) processes using PySpark, ensuring efficient data processing, transformation, and loading from diverse sources into data lakes, warehouses, or databases.

Distributed Computing with PySpark :

- Leverage Apache Spark and PySpark to process large-scale data in a distributed computing environment, optimizing for performance and scalability.

Cloud Data Solutions :

- Develop and deploy data pipelines and processing frameworks on cloud platforms (AWS, Azure, GCP) using native tools like AWS Glue, Azure Databricks, or Google Dataproc.

Data Integration & Transformation :

- Integrate data from various internal and external sources, ensuring data consistency, quality, and reliability throughout the pipeline.

Performance Optimization :

- Optimize PySpark jobs and pipelines for faster data processing, handling large volumes of data efficiently with minimal latency.

- Proven experience as a Data Engineer or similar role, with a strong background in database development, ETL processes, and software development.

- Proficiency in SQL and scripting languages such as Python, with experience working with relational databases.

- Proficiency in dataProc (PySpark), Pandas or other data processing libraries

- Experience with data modeling, schema design, and optimization techniques for scalability.

- Strong analytical and problem-solving skills, with the ability to troubleshoot complex data issues and optimize data processing pipelines for scale

Required Qualifications :

Experience :

- 4-8 years of experience in data engineering, with a strong focus on PySpark and large-scale data processing.

Technical Skills :

- Expertise in PySpark for distributed data processing, data transformation, and job optimization.

- Strong proficiency in Python and SQL for data manipulation and pipeline creation.

- Hands-on experience with Apache Spark and its ecosystem, including Spark SQL, Spark Streaming, and PySpark MLlib.

- Solid experience working with ETL tools and frameworks, such as Apache Airflow or similar orchestration tools.

(ref:hirist.tech)

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 303145 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: As a data...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 312575 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: As a Data...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 313953 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bamgalore, Karnātaka (IN-KA), India (IN).Job Duties: Design and...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 313951 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Design and...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 313949 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Design and...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 313839 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Key...

  • Data Visualization Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 294615NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Visualization Engineer - Qlik Sense to join our team in Bangalore Karn xc4 x81taka IN-KA India IN ...

  • Sr Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 286326NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Sr data engineer to join our team in Bangalore Karn xc4 x81taka IN-KA India IN Senior data engineer ...

  • Snowflake Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 317559 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Snowflake Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Data...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 293309NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer Tableau SQL to join our team in Bangalore Karn xc4 x81taka IN-KA India IN Job Duties ...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 317060 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Azure Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: •...

  • Data Engineer Specialist

    1 day ago

    Bengaluru, Karnataka, India NTT DATA Full time

    We are looking for a skilled Data Engineer to join our team at NTT DATA. In this role, you will be responsible for building and implementing data pipelines using PySpark and Azure Synapse. Your expertise in dimensional and star data models will enable us to optimize access using Power BI.Job Duties:Build and implement PySpark-based data pipelines in Azure...

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: 312575 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: As a Data Engineer, you will...

  • Data Engineering Content Specialist

    7 days ago

    Bengaluru, Karnataka, India Hevo Data Full time

    Data Engineer Content Specialist RoleHevo Data is looking for an experienced content specialist to create high-quality, user-focused content that showcases our expertise in data engineering and analytics.As a data engineer content specialist, you will be responsible for developing a comprehensive content strategy that drives engagement and conversion. Your...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: 313953 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bamgalore, Karnātaka (IN-KA), India (IN).Job Duties: Design and implement tailored...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: 313952 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Design and implement tailored...

  • Data Engineer Tester

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 307085 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer Tester to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Primary...

  • Sr. Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 309995 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr. Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Primary Responsibility...

  • Sr. Data Engineer

    17 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 309986 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr. Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Primary Responsibility...

  • Offshore Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Req ID: 310544 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Offshore Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Key...