Senior Big Data Developer

2 days ago

Ghaziabad, Uttar Pradesh, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Job Title: Enterprise Data Architect

This role involves building high-performance data pipelines, collaborating with data scientists and stakeholders to deliver end-to-end solutions.

Key Responsibilities:
  • Design and develop scalable data architectures and ETL workflows.
  • Manage and process large datasets using Spark, PySpark, and SQL.
  • Develop and maintain real-time streaming applications with Spark Streaming/Kafka.
  • Collaborate with data scientists and product teams to integrate AI/ML models into production environments.
  • Ensure data quality, scalability, and performance in all pipelines.
  • Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks).
  • Automate testing and deployment of Spark jobs via CI/CD pipelines.
Requirements:
  • Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, PySpark.
  • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution.
  • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow/Prefect for scheduling and orchestration.
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.
  • Exposure to testing and CI/CD for data pipelines (pytest, Jenkins, GitHub Actions).

As an Enterprise Data Architect, you will play a critical role in shaping the future of our data-driven organization. We are looking for a highly skilled individual who can design, build, and maintain scalable data architectures that drive business growth and innovation.

  • Senior Business Intelligence Developer

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data EngineerWe are seeking an expert in Telemetry, Big Data and backend engineering to help implement an application for a leading retailer. The ideal candidate will have hands-on coding expertise in Python and Pyspark.

  • Senior Data Engineer

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join our team. As a key member of our data engineering group, you will design, develop, and maintain large-scale data pipelines and ETL processes on Databricks.The ideal candidate will have 7+ years of experience in Data Engineering and a proven track record of delivering...

  • Unlock Your Potential as a Senior Data Integration Specialist

    12 hours ago

    Ghaziabad, Uttar Pradesh, India beBeeDataSpecialist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Integration SpecialistRole Overview:We are seeking a seasoned Senior Data Integration Specialist to lead our data engineering initiatives. As a key member of our team, you will be responsible for architecting and implementing end-to-end data pipelines and integration solutions for varied structured and unstructured data sources and targets.The...

  • Data Engineer

    3 weeks ago

    Ghaziabad, Uttar Pradesh, India Indsafri Full time

    Hiring Now: Senior Data Engineers (Banking Domain – 2 Positions)Location: RemoteExperience: 7+ Years | Banking sector experience preferred Type: Contract About the OpportunityWe're looking for highly skilled Senior Data Engineers to join a mission-critical banking project. This is your chance to work on cutting-edge data pipelines, streaming platforms,...

  • Senior Transformation Data Specialist

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 2,50,000

    Big Data Engineer PositionTransformative Data Solutions Specialist - BrightEdge is a leading SEO and content performance marketing platform that turns online content into tangible business results. Our data-driven platform processes massive amounts of information to provide actionable insights to our clients.Role Overview As a Big Data Engineer at...

  • Data Engineer

    3 weeks ago

    Ghaziabad, Uttar Pradesh, India Quess IT Staffing Full time

    Hi All,GreetingWe have hirings at Gurugram Location for following role:Hands on in SQL and its Big Data variants (Hive-QL, Snowflake ANSI, Redshift SQL)Python and Spark and one or more of its API (PySpark, Spark SQL, Scala), Bash/Shell scriptingExperience with Source code control - GitHub, VSTS etc.Knowledge and exposure to Big Data technologies Hadoop stack...

  • Data Security Specialist

    3 days ago

    Ghaziabad, Uttar Pradesh, India beBeeSupport Full time ₹ 15,00,000 - ₹ 22,10,000

    Senior Support Engineer Position Overview">We are seeking a seasoned technical professional to serve as a Senior Support Engineer. This role involves delivering exceptional technical support for our data security and governance platform, ensuring customer adoption, satisfaction, and retention.Key Responsibilities:Customer Support & Case ManagementAct as the...

  • Data Specialist

    13 hours ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time US$ 32,000 - US$ 62,000

    Expert Data Scientist and ArchitectWe are seeking an experienced data architect to join our global engineering team for a multi-year project initiative.Key Skills:Data Warehouse EngineeringBig Data AnalyticsData GovernanceThe ideal candidate will have at least 5-8 years of experience as a senior data engineer, with strong expertise in data...

  • Senior AI Developer

    12 hours ago

    Ghaziabad, Uttar Pradesh, India beBeeArtificial Full time ₹ 20,00,000 - ₹ 25,00,000

    Job SummaryAI Engineer Position OverviewOur team seeks a skilled Artificial Intelligence Engineer to lead the development of cutting-edge AI solutions.Key Responsibilities:Implement and fine-tune AI-generated text prompts using Large Language Models (LLMs) such as GPT-4.Utilize AI-specific tools like ChatGPT, Hugging Face Transformers, and OpenAI for...

  • Senior Data Developer

    15 hours ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000

    At Tuva, we strive to empower every student with the tools to make sense of data and their surroundings. We're seeking a Visualizer who is passionate about crafting engaging, interactive visualizations that bring learning to life for millions. About Data VisualizationWe design accessible, engaging learning experiences that make data meaningful for all...