Senior engineer, data engineering
2 weeks ago
As a Data Engineer specializing in geospatial data, your primary responsibility is to design, build, and maintain data infrastructure and systems that handle geospatial information effectively. You will work closely with cross-functional teams, including data scientists, geospatial analysts, and software engineers, to ensure that geospatial data is collected, processed, stored, and analyzed efficiently and accurately. Sat Sure is a deep tech, decision Intelligence company that works primarily at the nexus of agriculture, infrastructure, and climate action creating an impact for the other millions, focusing on the developing world. We want to make insights from earth observation data accessible to all. If you are interested in working in an environment that focuses on the impact on society, driven by cutting-edge technology, and where you will be free to work on innovative ideas and be creative with no hierarchies, Sat Sure is the place for you. Data Pipeline Development: Design and implement robust data pipelines to acquire, ingest, clean, transform, and process geospatial data from various sources such as satellites, aerial, drones, and geolocation services. Data Ingestion, Storage and Extraction: Develop data models and schemas tailored to geospatial data structures, ensuring optimal performance and scalability for storage and retrieval operations. Spatial Database Management: Manage geospatial databases, including both traditional relational databases (e.g., Postgre SQL with Post GIS extension) and No SQL databases (e.g., Mongo DB, Cassandra) to store and query spatial data efficiently. Geospatial Analysis Tools Integration: Integrate geospatial analysis tools and libraries (e.g., GDAL, Geo Pandas, Fiona) into data processing pipelines and analytics workflows to perform spatial data analysis, visualization, and geoprocessing tasks. Geospatial Data Visualization: Collaborate with data visualization specialists to create interactive maps, dashboards, and visualizations that effectively communicate geospatial insights and patterns to stakeholders. (frontend related)Performance Optimization: Identify and address performance bottlenecks in data processing and storage systems, leveraging techniques such as indexing, partitioning, and parallelization to optimize geospatial data workflows. Data Quality Assurance: Implement data quality checks and validation procedures to ensure the accuracy, completeness, and consistency of geospatial data throughout the data lifecycle. Geospatial Data Governance: Establish data governance policies and standards specific to geospatial data, including metadata management, data privacy, and compliance with geospatial regulations and standards (e.g., Collaboration and Communication: Collaborate with cross-functional teams to understand geospatial data requirements and provide technical expertise and support. Communicate findings, insights, and technical solutions effectively to both technical and non-technical stakeholders. Bachelor's or Master's degree in Computer Science or a related field. ~3-5 years of experience working in the field and deploying the pipelines in production. ~ Strong programming skills in languages such as Python, Java, or Scala, with experience in geospatial libraries and frameworks (e.g., Experience with distributed computing frameworks (e.g., Apache Spark, Airflow) and cloud-based data platforms (e.g., AWS, Azure, Google Cloud Platform). ~ Familiarity with geospatial data formats and standards (e.g., Geo JSON, Shapefile, KML) and geospatial data visualization tools (e.g., Mapbox, Leaflet, Tableau). ~ Proficiency in SQL and experience with geospatial extensions for relational databases (e.g., Nice to have experience with geospatial libraries such as Rasterio, Xarray, Geopandas, and GDAL. STAC, Geo Parquet, Cloud native tools. Productionising Data Science code. The role of a Data Engineer for Geospatial Data is crucial in enabling organizations to leverage the power of geospatial information for various applications, including urban planning, environmental monitoring, transportation, agriculture, and emergency response. Medical Health Cover for you and your family, including unlimited online doctor consultations Dedicated allowances for learning and skill development Comprehensive leave policy with casual leaves, paid leaves, marriage leaves, bereavement leaves Intro call
-
Senior Data Engineer
1 week ago
bangalore, India HireAlpha Full timeSenior Data Engineer (Informatica Platform Engineer / Administrator) – Bangalore We’re looking for a Senior Data Engineer with strong expertise in Informatica platform administration to join our Group IT Data Engineering team.This role is ideal for professionals who enjoy building and maintaining enterprise-grade data platforms that power large-scale...
-
Senior engineer
2 weeks ago
Bangalore, India Yield Engineering Systems Full timeYES (Yield Engineering Systems, Inc.) is a leading manufacturer of reliable, high-tech, cost-effective capital equipment that transforms materials and surfaces at the nanoscale. From startups to the Fortune 50, our customers rely on YES to help them unleash products that change lives – from cellphones and Io T devices, to AI and virtual reality, to...
-
Senior engineer, data engineering
2 weeks ago
Bangalore, India USEReady Full timeJob Title: Senior Databricks Engineer Experience Level: 5-8 Years As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable...
-
Senior Data Engineer
3 days ago
bangalore, India 6thStreet.com Full timeJob Title: Senior Data Engineer Location: Bangalore Experience: 3-5 Years Department: Data & Analytics Employment Type: Full-timeAbout the RoleWe’re looking for a Senior Data Engineer to lead the design, development, and scaling of our data infrastructure. You’ll shape best practices, mentor junior engineers, and ensure our data ecosystem empowers...
-
Senior data engineer
2 weeks ago
Bangalore, India ITC Infotech Full timeSenior Data Engineer - Azure Stack Experience - 3-12 years Location : Bangalore, Kolkata, Gurgaon, Pune We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and...
-
Senior Data Engineer
2 weeks ago
Bangalore, India ITC Infotech Full timeSenior Data Engineer - Azure Stack Experience - 3-12 years Location : Bangalore, Kolkata, Gurgaon, Pune We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based...
-
Senior Data Engineer
1 week ago
bangalore, India ITC Infotech Full timeSenior Data Engineer - Azure StackExperience - 3-12 yearsLocation : Bangalore, Kolkata, Gurgaon, PuneWe are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions...
-
Senior Data Engineer
1 week ago
bangalore, India PASO Co Full timeJob descriptionWe’re Hiring: Senior Data Engineer | Remote (Pan India) | Full-TimeAbout the RoleOne of our client l is looking for a Senior Data Engineer to design and optimize data pipelines, ensure smooth data flow, and support multiple teams with reliable, scalable data solutions. If you love building data systems from the ground up and have hands-on...
-
Electrical engineer
2 weeks ago
Bangalore, India Yield Engineering Systems Full timeYES (Yield Engineering Systems, Inc.) is a leading manufacturer of reliable, high-tech, cost-effective capital equipment that transforms materials and surfaces at the nanoscale. From startups to the Fortune 50, our customers rely on YES to help them unleash products that change lives – from cellphones and Io T devices, to AI and virtual reality, to...
-
Senior data engineer
3 weeks ago
Bangalore, India USEReady Full timeJob Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and...