Data Engineering Resources

Azure Stream Analytics Upsert Operation Using Cosmos DB

Upsert operations allow you to update existing records or insert new ones based on specific criteria within your streaming pipelines.

March 15, 2024

by Amlan Patnaik

· 3,493 Views · 1 Like

How to Setup RAID10 on Dell Servers

Understanding different types of storage configurations is important and today we will discuss how we can achieve redundancy and performance by using RAID arrays.

March 15, 2024

by Prashanth Ravula

· 3,239 Views · 4 Likes

Data Flow Diagrams for Software Engineering

This article provides fundamental knowledge about DFDs, highlighting their benefits and guiding you on how to leverage them effectively.

March 14, 2024

by Stelios Manioudakis

CORE

· 12,393 Views · 4 Likes

Data Lake vs. Data Warehouse: 10 Key Differences

In this article, learn more about the ten major differences between data lakes and data warehouses to make the best choice.

March 14, 2024

by Waris Husain

· 2,391 Views · 1 Like

Building Safe AI: A Comprehensive Guide to Bias Mitigation, Inclusive Datasets, and Ethical Considerations

Data quality is key for fair AI. Biased or incomplete datasets lead to AI models that make unfair or inaccurate decisions, harming individuals and eroding trust.

March 14, 2024

by Ramakrishnan Neelakandan

· 3,569 Views · 3 Likes

Mastering AWS API Gateway: A Comprehensive Guide To Setting up Routes, Integrations, and Deployments

In this article, we will walk through the process of setting up AWS API Gateway with a Network Load Balancer (NLB), Target Group, Security Group, and VPC.

March 14, 2024

by Vijay Panwar

· 3,415 Views · 1 Like

Qumulo Unifies Data Across the Enterprise With Scale Anywhere Data Platform

Qumulo's CTO explains how the company's Scale Anywhere Data Platform unifies unstructured data across edge, core, and cloud for easy management and access.

March 14, 2024

by Tom Smith

CORE

· 2,183 Views · 1 Like

Is Computer Vision Difficult To Use?

Computer vision is a type of artificial intelligence that helps the computer to see the world, make interpretations, and analyze the visual world.

March 14, 2024

by Amrutha TESR

· 2,109 Views · 1 Like

BPMN 2.0 and Jakarta EE: A Powerful Alliance

Jakarta EE, combined with BPMN 2.0, forms a powerful alliance for developing robust, scalable, and interoperable BPM solutions.

March 14, 2024

by Ralph Soika

· 3,636 Views · 3 Likes

Test Parameterization With JUnit 5.7: A Deep Dive Into @EnumSource

@EnumSource makes an impression of an esoteric device that can hardly feel useful. Though, for the right problem, they are priceless. Find out where they shine.

March 14, 2024

by Oliver Gondza

· 5,706 Views · 9 Likes

Cohesity Simplifies Data Management and Security for Developers

Simplified data management and security for developers with a converged, AI-powered platform streamlines workflows and unlocks insights.

March 14, 2024

by Tom Smith

CORE

· 3,184 Views · 1 Like

Foundations of Data in the Cloud

Exploring cloud data management, and its layered structure from secure storage to processing and application, presentation, all underpinned by robust security measures.

March 14, 2024

by Suhas Jangoan

· 3,722 Views · 3 Likes

Bridging the Gap: The Limits of AI Guardrails in Addressing Human Bias

Generative AI's power and bias highlight the need for technological guardrails alongside broader efforts to confront the enduring challenge of human bias.

March 14, 2024

by Navveen Balani

· 2,771 Views · 2 Likes

Machine Learning: A Revolutionizing Force in Cybersecurity

Explore the power of ML in cybersecurity to uncover hidden patterns, identify potential threats proactively, and bolster our defenses against evolving cyber threats.

March 13, 2024

by Phani Kumar Varma Kokkerlapati

· 2,755 Views · 2 Likes

Azure Cognitive Search Unveiled: Building Intelligent Search Solutions With AI

This article offers a practical guide on setting up Azure Cognitive Search, and integrating AI functionalities, and includes code samples.

March 13, 2024

by venkataramaiah gude

· 1,928 Views · 2 Likes

MQTT Market Trends for 2024: Cloud, Unified Namespace, Sparkplug, Kafka Integration

Market trends for MQTT: Data Governance with Unified Namespace and Sparkplug B, OPC-UA Debates, and Integration with Apache Kafka for OT/IT.

March 13, 2024

by Kai Wähner

CORE

· 1,368 Views · 1 Like

Evaluating and Building Applications on Open Source Large Language Models

How do you choose the most appropriate model for your application? An analysis of evaluating and building applications on open-source large language models.

March 13, 2024

by George Anadiotis

· 1,360 Views · 2 Likes

Mixtral: Generative Sparse Mixture of Experts in DataFlows

Explore the use of a new type of GenAI LLM with streaming pipelines in this tutorial about how to build a real-time LLM flow with Mixtral AI's new open model.

March 13, 2024

by Tim Spann

CORE

· 1,791 Views · 2 Likes

Too Many Indexes [Comic]

Indexes slowing you down? You're not alone. Check out this comic on too many indexes and how it impacts speed, queries, and your database.

March 13, 2024

by Daniel Stori

CORE

· 2,010 Views · 3 Likes

The Role of Artificial Intelligence in Modern Software Architecture Design

Explore the integration, optimization, challenges, and future of Artificial Intelligence in modern software architecture design.

March 13, 2024

by Boris Bodin

· 2,083 Views · 3 Likes

The Latest Data Engineering Topics