Data Engineering Resources

Revolutionizing Real-Time Alerts With AI, NATS, and Streamlit

Build a real-time AI-powered weather alert chat application using OpenAI, NATs, and Streamlit. Understand how modern real-time alerting systems work.

February 20, 2024

by Bobur Umurzokov

· 2,343 Views · 2 Likes

Insights From AWS Re:Invent 2023

This article highlights the latest cloud computing advancements from AWS re:Invent 2023, and their global impact on technology's future.

February 20, 2024

by Rajat Gupta

· 3,218 Views · 6 Likes

Building for the Metaverse: Essential Tools and Frameworks for Developers

Let's push the boundaries of digital interaction and redefine the future of the Metaverse together through decentralized economies created by technology.

February 20, 2024

by Muzammil Rawjani

· 1,872 Views · 2 Likes

Vector Database for LLMs, Generative AI, and Deep Learning

Unlike traditional databases that handle scalar data (like numbers, strings, or dates), vector databases are optimized for high-dimensional data points.

February 20, 2024

by Kevin Vu

· 1,846 Views · 1 Like

AWS vs. Azure: Which Is Better for Cloud Computing?

In this article, discover the key features that can help you settle the AWS vs. Azure debate when picking a cloud provider.

February 20, 2024

by Anthony Neto

· 2,393 Views · 2 Likes

MLOps vs. DevOps: The Key Similarities and Differences

DevOps integrates software applications, and MLOps implements quality checks and tests for data pipelines and machine learning model training and deployment.

February 20, 2024

by Florian Pialoux

· 1,902 Views · 1 Like

Decoding Large Language Models and How They Work

The article reviews how Large Language and Multimodal Models process text and images using tokenization, embeddings, and architectures like CNNs and ViTs.

February 20, 2024

by Smit Dagli

· 1,691 Views · 1 Like

How To Integrate NCache With JPA Hibernate for Caching in Spring Boot Applications

In this article, let’s discuss the caching feature of Hibernate with NCache for caching in a Spring Boot application with an illustrating example.

February 20, 2024

by Sriram Kumar Mannava

· 4,505 Views · 2 Likes

Data Mesh: A Paradigm Shift in Data Management

Data mesh is a new technology that could provide a framework for managing distributed data ecosystems more effectively by treating data as a product.

February 20, 2024

by Suresh Martha

· 2,009 Views · 2 Likes

AI and Microservice Architecture, A Perfect Match?

AI and Microservices blend, revolutionizing software with scalable, flexible, and efficient solutions, navigating through complexity and security hurdles.

February 20, 2024

by Dileep Pandiya

· 2,428 Views · 1 Like

Disaster Recovery and High Availability Solutions in SQL Server

Learn about always-on availability groups, database mirroring, log shipping, and replication as methods of disaster recovery and high availability.

February 20, 2024

by Smit Dagli

· 2,274 Views · 1 Like

Exploring Parallel Processing: SIMD vs. MIMD Architectures

We will discuss SIMD and MIMD architectures and how they play vital roles in enhancing computational efficiency and facilitating parallel processing tasks.

February 20, 2024

by Aditya Bhuyan

· 3,079 Views · 2 Likes

A Deep Dive Into Data Orchestration With Airbyte, Airflow, Dagster, and Prefect

This article delves into the integration of Airbyte with some of the most popular data orchestrators in the industry – Apache Airflow, Dagster, and Prefect.

February 20, 2024

by John Lafleur

· 2,644 Views · 2 Likes

Distributed Task Synchronization: Leveraging ShedLock in Spring

In this article, learn how to execute tasks in distributed systems using ShedLock, a useful tool for coordinating tasks in complex Spring applications.

February 19, 2024

by Viacheslav Shago

· 2,730 Views · 4 Likes

Spring Boot 3.2: Replace Your RestTemplate With RestClient

This Spring Boot 3.2 tutorial explores an addition built upon WebClient called RestClient, a more intuitive and modern approach to consuming RESTful services.

February 19, 2024

by Fernando Boaglio

· 8,582 Views · 7 Likes

Building and Integrating REST APIs With AWS RDS Databases: A Node.js Example

This guide walks through the process of creating a RESTful API that talks to an Amazon Relational Database Service (RDS) instance, complete with examples.

February 19, 2024

by Vijay Panwar

· 4,485 Views · 2 Likes

Python Function Pipelines: Streamlining Data Processing

Function pipelines allow seamless execution of multiple functions in a sequential manner, where the output of one function serves as the input to the next.

February 19, 2024

by Sameer Shukla

CORE

· 4,248 Views · 7 Likes

Recover Distributed Transactions in MySQL

How to identify and troubleshoot distributed (XA) transactions stuck in the prepared state in MySQL using XA recover, XA commit, and XA rollback commands.

February 19, 2024

by Tasos Papadopoulos

· 2,322 Views · 1 Like

How To Deploy Machine Learning Models Using Amazon SageMaker

Learn how to deploy machine learning models efficiently using Amazon SageMaker. Discover step-by-step instructions, advantages, and expert assistance from Softweb.

February 19, 2024

by Chiragsinh Vaghela

· 1,657 Views · 2 Likes

Top 5 Trends for Data Streaming With Kafka and Flink in 2024

Top 5 Trends for Data Streaming with Apache Kafka and Flink: data sharing, data contracts, multi-cloud, serverless stream processing, GenAI.

February 19, 2024

by Kai Wähner

CORE

· 3,674 Views · 2 Likes

The Latest Data Engineering Topics