Knowledge of Databricks and Spark for big data processing and analytics. Architect and implement ETL processes to extract, transform, and load data efficiently. Design, implement, and manage Azure-based solutions, leveraging services like Azure Data Factory, Azure SQL Database, Azure DevOps, etc.

You will be involved in holistic surveillance build out which will require excellent understanding and hands-on experience in big data (Hadoop - Cloudera stack) technologies like hive, spark, Kafka, Angular JS to architect, develop and support sophisticated analytics pipeline using Machine Learning algorithms.

Big Data Engineer. 5+ years of experience in building data engineering solutions utilizing AWS services (S3, Kinesis, Lambda, Glue, SNS) or Data platforms like Databricks/Cloudera.

Strong experience with Hadoop, Impala, Pig, Hive, YARN, and other big data technologies. Architect the data warehouse infrastructure at Reibus. 5+ years experience performing data warehouse architecture development and management across one or more data warehouse solutions including BigQuery, Synapse, Teradata, Vertica, or Snowflake.

You'll code with machine learning languages like DataBricks and Python Libraries to synthesize millions of data sets into patterns that answer ad hoc requests and then use Tableau for data visualization.

Advance experience with developing Data Pipeline, ETL/ELT, utilizing tooling of Big Data Platform, Datalake, Synapse, Airflow, AirByte, Snowflake. Experience with Data Ingestion/ streaming tooling such as ADF (Azure Data Factory), Kafka, Five Tran, Spark, or similar technologies.

Hands-on experience with big data technologies and cloud (Databricks / Spark, Azure/AWS/GCP). Excellent understanding of data mining, predictive modeling, and data visualization.

As ABSC’s Data Scientist , your job will be to perform cutting edge data analytics and support a major program advancing the state of the art in mission-focused big data analytics and predictive analytics.

Reporting directly to the Director, Business Applications, this position will be responsible for leading data strategy, contributing to enterprise data lake & analytics platforms using Snowflake, Fivetran and DBT technologies and drive standardization, operational excellence across the organization.

Strong skills in writing SQL queries using databases like Redshift, Microsoft SQL Server, or other industry leading RDBMS.Proven ability to serve as a subject matter expert and trusted advisor on future-proofing big data infrastructure and business strategies for cloud environment.

Use Azure Databricks for big data processing and analytics. Leverage Azure Data Factory and Azure Databricks for data integration and ETL processes. Azure Data Factory, Azure DataBricks, Python experience is a plus.

Proven experience as a Technical Lead with a focus on Databricks and big data technologies on Azure Cloud Platform. Optimize the performance of big data processing tasks and analytics jobs.

Incorporate the latest methodologies such Big Data, Artificial Intelligence (AI), Machine Learning (ML), Data Harvesting and Content Curation to modernize the Warfighter Support Office's data pipeline.

Job Req ID: 23798 About Supermicro: Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide.

You will have a good understanding of business intelligence tools, data warehouses, master data management, data integration, documents and content, data modelling and design, ML/Big Data, analytics and dashboarding.