Data Engineer for Large-Scale Big Data Solutions

3 days ago


Hyderabad, Telangana, India Alignity Solutions Full time

We are seeking an experienced data engineer to join our team at Alignity Solutions in Mumbai. The ideal candidate will have expertise in Apache Spark and Python programming, focusing on building scalable, high-performance data processing pipelines.

Job Description:

The role of a PySpark Developer involves developing, testing, and maintaining large-scale data processing systems using PySpark and other big data technologies. This includes designing and implementing data pipelines to extract, transform, and load data from various data sources, ensuring scalability and reliability. Additionally, the successful candidate will work with cross-functional teams to understand requirements and provide solutions that meet business needs.

This position requires a strong understanding of data lake and data warehouse concepts and best practices, as well as knowledge of data partitioning, caching, and other optimization techniques in Spark. Experience with data orchestration tools (e.g., Apache Airflow) and NoSQL databases (e.g., Cassandra, MongoDB) is also preferred.

Requirements:
  • Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).
  • 2+ years of hands-on experience in PySpark, Spark SQL, and Spark DataFrames.
  • Proficiency in Python programming, with experience in data manipulation and processing.
  • Strong knowledge of Apache Spark architecture and experience working with large datasets in a distributed environment.
Salary: ₹12-18 Lakhs per annum

This estimate is based on industry standards for a similar role in Mumbai, India. We offer competitive compensation and benefits packages to attract top talent.

Benefits:

At Alignity Solutions, we value our employees' growth and well-being. Our benefits package includes:

  • Competitive salary and bonuses.
  • Opportunities for professional development and skill enhancement.
  • A collaborative and dynamic work environment.

We are an equal opportunity employer and welcome applications from diverse candidates. If you are passionate about big data engineering and eager to take on new challenges, please submit your application.


  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...


  • Hyderabad, Telangana, India data Full time

    Unlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...


  • Hyderabad, Telangana, India FedEx ACC Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at FedEx ACC. This is a critical role that requires expertise in designing, developing, and deploying large-scale data engineering solutions.Key Responsibilities:Design, develop, and deploy scalable data pipelines using Azure tools such as Data Factory, DataFlow, Databricks, and...


  • Hyderabad, Telangana, India DBS Bank Full time

    Job Title: Data Engineer for Big Data SolutionsRole Overview:As a Data Engineer for Big Data Solutions, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies. You will work closely with cross-functional teams to understand business requirements and translate them into effective...

  • Data Modeling Expert

    4 weeks ago


    Hyderabad, Telangana, India data Full time

    What drives innovation in data-driven products?We are looking for an experienced data engineer to join our team and contribute to the development of innovative analytics and data products. As a big data engineer, you will be part of a collaborative team that uses agile methodologies and open-source technologies to build cutting-edge data processing programs....

  • Big Data Engineer

    1 month ago


    Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    About the Role:Vidpro Consultancy Services is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing large-scale Big Data architectures using Java and Python.Key Responsibilities:Design and implement Big Data architectures using Hadoop and SparkDevelop...

  • Big Data Engineer

    1 month ago


    Hyderabad, Telangana, India TechSophy Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...


  • Hyderabad, Telangana, India Radiant Systems (India) Pvt. Ltd. Full time

    As a Big Data Solutions Architect at Radiant Systems (India) Pvt. Ltd., you will design, build, and maintain big data solutions using PySpark, Hadoop, and SQL Server. Key responsibilities include developing and optimizing ETL processes to handle large-scale data processing and integration, utilizing SQL and PySpark for data manipulation, transformation, and...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Data Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...


  • Hyderabad, Telangana, India Aricent Full time

    Job DescriptionWe are seeking a skilled Senior Big Data Engineer to design and build solutions for a Fortune 500 client program. The project involves creating a data standardized and curation-based Hadoop cluster.About the RoleThis is a high-visibility, fast-paced key initiative that will integrate data across internal and external sources, provide...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Ninja Van Full time

    About Ninja VanNinja Van is a leading logistics company in Southeast Asia, leveraging innovation and technology to drive efficiency and convenience in the delivery of goods. Founded in 2014 in Singapore, we have rapidly expanded to become one of the largest and fastest-growing express logistics companies in the region.Key ResponsibilitiesThe successful...

  • Senior Data Engineer

    1 month ago


    Hyderabad, Telangana, India NTT DATA Business Solutions Full time

    A Senior Data Engineer plays a pivotal role in technology-driven organizations, responsible for designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Responsibilities:Designing and Implementing ETL Processes:Develop and maintain scalable data pipelines.Create efficient Extract,...


  • Hyderabad, Telangana, India Findernest Software Services Pvt Ltd Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at Findernest Software Services Pvt Ltd. As a Senior Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable big data solutions that drive business growth and decision-making.Key ResponsibilitiesDesign and implement big data...

  • Staff Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    About NTT DATA ServicesNTT DATA Services is a recognized leader in IT and business services, offering cloud, data, and applications expertise. Headquartered in Texas, we provide business and technology consulting, industry and digital solutions, application development and management, and more. Our commitment to our clients' long-term success drives us...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India ADCI HYD 13 SEZ Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Amazon Business Data Analytics and Insights team. As a Data Engineer, you will play a key role in designing and implementing large-scale data integration and delivery services. These data solutions will be used in periodic reporting and drive business decision making.Key...


  • Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...

  • Data Architect

    4 weeks ago


    Hyderabad, Telangana, India NTT DATA Business Solutions Full time

    A Data Architect at NTT DATA Business Solutions plays a pivotal role in designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Key Responsibilities:Designing and Implementing ETL Processes:Develop scalable data pipelines and create efficient Extract, Transform, Load (ETL)...

  • Data Analyst Position

    4 weeks ago


    Hyderabad, Telangana, India data Full time

    A Career Defining Role in Data IntelligenceAs a Data Analyst, you will play a pivotal role in helping us uncover hidden insights and trends within our vast dataset. Your expertise will be instrumental in ensuring the accuracy and quality of our data, enabling us to make informed decisions that drive business growth.ResponsibilitiesTake ownership of data.ai's...


  • Hyderabad, Telangana, India SPG Consulting Full time

    At SPG Consulting, we are seeking a highly skilled and experienced Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be working on designing, building, and maintaining large-scale distributed systems using Scala and Spark.Key Responsibilities:Design and develop high-performance, scalable, and fault-tolerant...