Data Engineering Resources

AI Revolution Journey With Qwen, RAG, and LangChain

This article provides an insightful exploration of the AI Revolution journey, delving into the concepts of Qwen, Retrieval-Augmented Generation (RAG), and LangChain.

March 19, 2024

by Farruh Kushnazarov

· 1,195 Views · 1 Like

Extracting Keywords From Text Using Natural Language Processing

With this article, I would like to help you broaden your understanding of NLP and show how spaCy can be your powerful ally in effective keyword extraction.

March 19, 2024

by Akshay Jain

· 1,436 Views · 2 Likes

ChatGPT Code Smell [Comic]

What is that smell? In this latest comic from Daniel Stori, discover the result of ChatGPT-generated code.

March 19, 2024

by Daniel Stori

CORE

· 2,034 Views · 1 Like

Kafka Message Filtering: An Analysis

An analysis of how to implement a Kafka message filtering strategy, first as a general approach, then with the consumer needing to recover after deserialization errors.

March 19, 2024

by Horatiu Dan

· 1,373 Views · 1 Like

Secure Your API With JWT: Kong OpenID Connect

In this article, walk through the issues of session-based authorization and the benefits of stateless tokens, namely JWT.

March 19, 2024

by Adam Zaręba

· 3,232 Views · 3 Likes

Harmonizing AI: Crafting Personalized Song Suggestions

Diving into machine learning, I developed "EmotiTuneOT," a system recommending songs based on users' emotions, using DeepLake and LangChain.

March 19, 2024

by Nacho Corcuera

· 1,846 Views · 1 Like

Exploring Zero-Trust Architecture Implementation in Modern Cybersecurity

Zero-trust flips conventional security on its head by shifting from an implicit trust model to one where verification is required every step of the way.

March 19, 2024

by Igboanugo David Ugochukwu

· 2,879 Views · 2 Likes

Breaking Down Data Silos With a Unified Data Warehouse: An Apache Doris-Based CDP

An insurance company uses Apache Doris in replacement of Spark+Impala+HBase+NebulaGraph, in their Customer Data Platform for 4 times faster customer grouping.

March 19, 2024

by Frank Z

· 2,645 Views · 2 Likes

Using My New Raspberry Pi To Run an Existing GitHub Action

Experiment with self-hosted runner Raspberry Pi, using it to run an existing GitHub action. Read more about the author's findings!

March 18, 2024

by Nicolas Fränkel

CORE

· 2,234 Views · 2 Likes

Rethinking DevOps in 2024: Adapting to a New Era of Technology

Emerging technologies, evolving methodologies, and changing business needs are redefining what it means to implement DevOps practices effectively.

March 18, 2024

by Ankush Madaan

· 1,958 Views · 1 Like

LangChain, Python, and Heroku

In this tutorial, learn how to build and deploy LLM-based applications with ease using LangChain, Python, and Heroku for streamlined development and deployment.

March 18, 2024

by Alvin Lee

CORE

· 1,903 Views · 2 Likes

Power BI: Transforming Banking Data

As a data architect or data engineer, you know how vital it is to fully understand the power of your data. This task holds even more gravity in the banking sector.

March 18, 2024

by Serter Solak

· 1,715 Views · 2 Likes

Integrating Snowflake With Trino

Trino simplifies accessing Snowflake, highlighting its versatility in providing robust data management and analytics solutions for modern enterprises.

March 18, 2024

by Artem Ervits

CORE

· 3,926 Views · 1 Like

Crafting a Custom Sports Activity Service With OpenAI and Node.js

Development journey of a Node.js application with OpenAI integration, craft a tailored sports activity service that dynamically adapts to unique fitness indicators.

March 18, 2024

by Anton Kalik

· 2,382 Views · 1 Like

AI-Driven API and Microservice Architecture Design for Cloud

Incorporating AI into API and microservice architecture design for the Cloud can bring numerous benefits. Here are some key aspects.

March 18, 2024

by Nilesh Charankar

· 4,759 Views · 1 Like

Securing AWS RDS SQL Server for Retail: Comprehensive Strategies and Implementation Guide

This article provides a detailed guide on securing AWS RDS SQL Server instances, tailored for retail stores, with practical setup examples.

March 18, 2024

by Vijay Panwar

· 1,861 Views · 1 Like

Building a Sustainable Data Ecosystem

Generative AI brings innovation, but it also brings challenges in privacy, fairness, and accountability in data sharing.

March 15, 2024

by Chidumga Izuzu

· 4,357 Views · 6 Likes

Understanding Softmax Activation Function for AI/ML Engineers

The article explains the softmax function's role in turning neural network outputs into probabilities for classification in machine learning.

March 15, 2024

by Pavan Belagatti

CORE

· 2,709 Views · 1 Like

Understanding the Power of AWS Organizations: Streamlining Cloud Management

AWS Organizations is a cloud management service provided by Amazon Web Services (AWS) that simplifies the administration of multiple AWS accounts within an organization.

March 15, 2024

by Saikrishna Chinthapatla

· 3,444 Views · 1 Like

Optimizing Model Training: Strategies and Challenges in Artificial Intelligence

When you train a model, you send data through the network multiple times. Think of it like wanting to become the best basketball player.

March 15, 2024

by Mirza Naeem

· 2,809 Views · 1 Like

The Latest Data Engineering Topics