Current jobs related to Senior PySpark Developer - Delhi, Delhi - NewVision Software


  • Delhi, Delhi, India Tata Consultancy Services Full time

    About Tata Consultancy ServicesTata Consultancy Services (TCS) is a global leader in IT services, consulting, and business solutions. With over 50 years of experience, TCS has been at the forefront of driving innovation and growth through technology.Job Title: Data Engineer for Azure Synapse and Pyspark DevelopmentThis role offers an exciting opportunity to...

  • Python Developer

    4 days ago


    Delhi, Delhi, India IntraEdge Full time

    Senior Python Engineer Role at IntraedgeWe are seeking an experienced Senior Python Engineer to join our dynamic team at Intraedge. This role will involve leveraging cutting-edge technologies such as PySpark, SQL, and AWS to drive business insights.Key Responsibilities:Design and develop large-scale systems using object-oriented programming...


  • Delhi, Delhi, India Antara Senior Care Full time

    Job Title: Senior Digital Marketing StrategistCompany Overview: Antara Senior Care is a leading provider of senior care services, and we are seeking a highly experienced Senior Digital Marketing Strategist to join our team.Salary: $120,000 - $150,000 per annum, depending on experience.Job Description:We are looking for a seasoned Performance Marketing...


  • Delhi, Delhi, India Recro Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineering Specialist to join our team at Recro. This is a key role that will involve designing, developing, and optimizing data pipelines and data assets using PySpark and Python.Key ResponsibilitiesDesign and develop scalable data architectures using PySpark and Python.Perform code optimization...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Job Title: Senior Palantir Foundry ExpertWe are seeking an experienced Palantir Foundry expert to join our team at Tata Consultancy Services (TCS).About the Role:This is a senior-level position that requires strong expertise in Palantir Foundry, SQL, Pyspark, and data warehousing. The ideal candidate will have experience in ontology design, building data...


  • Delhi, Delhi, India Recro Full time

    About the RoleWe are seeking an experienced Senior Data Engineer - Cloud Architect to join our team at Recro. As a key member of our engineering department, you will play a crucial role in designing and implementing large-scale data engineering projects.About YouTo be successful in this position, you should have a strong background in data engineering, cloud...


  • Delhi, Delhi, India C2E Consultancy Full time

    C2E Consultancy is seeking an exceptional Senior Data Architect and Lead Developer to join our team. We are looking for a highly skilled individual with expertise in data ingestion, pipeline design, and performance optimization.We offer a competitive salary of approximately $140,000 per year, along with a range of benefits that include health insurance,...


  • Delhi, Delhi, India SourceBae Full time

    Job Title: Senior Data Engineering DirectorAbout SourceBae:We are a forward-thinking organization dedicated to harnessing the power of data. Our mission is to drive innovation through cutting-edge technology and expertise.Salary: ₹2500000 - ₹3500000 per annum, depending on experienceJob Description:We are seeking an experienced Senior Data Engineering...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    We are seeking a highly skilled and experienced Senior Data Scientist Lead to join our team at Tata Consultancy Services.Job SummaryThe ideal candidate will have 5-10 years of experience in Machine Learning, Deep Learning, NLP, TensorFlow, Keras, Scipy, Pyspark, and Python. They should be well-versed in Mathematics of Statistics, Calculus, and Algebra, with...


  • Delhi, Delhi, India CodeVyasa Full time

    Job DescriptionWe are seeking a highly skilled Senior Big Data Engineer to join our team in Bangalore. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing pipelines using PySpark for both streaming and batch processing.Key Responsibilities:- Design, implement, and...


  • Delhi, Delhi, India ACL Digital Full time

    ACL Digital is a cutting-edge technology firm seeking an experienced Senior Data Architect to spearhead our data engineering initiatives. Based in Balewadi, Pune, this role requires a minimum of 5-8 years of experience.Estimated Salary: ₹25,00,000 - ₹40,00,000 per annumOur ideal candidate will have hands-on experience with Spark/PySpark, SQL, and data...


  • Delhi, Delhi, India AccedePro Private Limited Full time

    We are seeking a Senior Data Engineering Specialist to join our team at AccedePro Private Limited. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing systems.Key Responsibilities:- Design and implement data pipelines using Python and Databricks.- Develop and maintain ETL processes...


  • Delhi, Delhi, India Nisum Full time

    Job Title: Senior Data Architect - Azure SolutionsThis is a challenging opportunity to join our dynamic team at Nisum as a Senior Data Architect, focused on delivering scalable and efficient data solutions utilizing Azure cloud technologies. As a key member of our team, you will play a vital role in designing and implementing data-intensive architectures,...


  • Delhi, Delhi, India HCLTech Full time

    About HCLTechWe are a leading global technology company with a strong presence in the IT services industry. Our team of experts is passionate about delivering innovative solutions that drive business growth and success.Job Title: Senior Big Data Engineer - ETL Framework DeveloperLocation: Pan IndiaSalary: ₹ 25,00,000 - ₹ 40,00,000 per annumJob...


  • Delhi, Delhi, India Recro Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Recro. In this role, you will be responsible for designing and implementing scalable data pipelines and building robust data assets.Salary: 23 LPAResponsibilitiesDesign and implement data pipelines using Pyspark/Python/Boto3, ensuring efficient and scalable data...

  • Senior Data Engineer

    2 weeks ago


    Delhi, Delhi, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading global IT services company. Our estimated salary range for this position in India is ₹25,00,000 - ₹40,00,000 per annum.Company OverviewTCS is a multinational company with a strong presence in the Indian market. We are committed to delivering high-quality services to our clients and providing a challenging work...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    About UsTata Consultancy Services is a global leader in IT services, consulting and business solutions that has been pioneering innovations in technology for over 50 years. At TCS, we solve complex business problems for our clients by leveraging emerging technologies like AI, ML, Cloud, IoT, Blockchain, etc.Job SummaryWe are seeking a highly motivated and...

  • Senior Data Engineer

    2 weeks ago


    Delhi, Delhi, India PRONEXUS CONSULTING PRIVATE LIMITED Full time

    **Job Title:** Senior Data Engineer - Big Data Pipeline SpecialistAt Pronexus Consulting Private Limited, we are seeking an experienced and highly skilled Senior Data Engineer - Big Data Pipeline Specialist to join our team. This role will involve designing, developing, and implementing large-scale data pipelines using various technologies such as Spark,...


  • Delhi, Delhi, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    About AEXONIC TECHNOLOGIES PRIVATE LIMITEDAEXONIC TECHNOLOGIES PRIVATE LIMITED is seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery.Job Description:We are looking for a seasoned Senior Big Data Engineer to join our...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    We are seeking a highly skilled Senior Palantir Developer to join our team. As a Senior Palantir Developer, you will be responsible for designing and implementing data pipelines using Palantir Foundry, automating ETL processes, and providing actionable insights through interactive dashboards and visualizations.Job DescriptionThis is an exciting opportunity...

Senior PySpark Developer

2 months ago


Delhi, Delhi, India NewVision Software Full time
Job Title: Senior PySpark Developer

We are seeking a highly skilled Senior PySpark Developer to join our team at NewVision Software. As a key member of our data engineering team, you will be responsible for designing and implementing Big Data systems using PySpark, database migration, transformation, and integration solutions for our Data warehousing projects.

Key Responsibilities:
  • Design and implement Big Data systems using PySpark
  • Develop data processing tasks using PySpark, including reading data from external sources, merging data, performing data enrichment, and loading into target data destinations
  • Integrate PySpark with downstream and upstream applications through batch/real-time interfaces
  • Fine-tune processes and troubleshoot performance issues
  • Develop design documents, such as HLD and LLD
  • Gather requirements and develop solution architecture for Data migration/integration initiatives
  • Lead a team in a project or a module
Requirements:
  • 4-6 years of experience in the design and implementation of Big Data systems using PySpark
  • Excellent knowledge of Apache Spark and Python programming experience
  • Hands-on experience with Azure ecosystem
  • Deep experience in developing data processing tasks using PySpark
  • Experience handling CDC operations for huge volumes of data
  • Data modeling experience using advanced statistical analysis and unstructured data processing
  • Experience with building APIs for provisioning data to downstream systems
Preferred Skills:
  • Experience in deployment and operationalizing code, knowledge of scheduling tools like Airflow and Control-M
  • Working experience on Cloud technology architecture like Azure ecosystem
  • Hands-on experience with Azure Filesystem operations
  • Good knowledge of Hadoop, Hive, and Cloudera/Hortonworks Data Platform

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are a motivated and experienced Senior PySpark Developer looking for a new challenge, please submit your application.