DEV Community

# bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The two versions of Parquet

The two versions of Parquet

2
Comments
5 min read
How to Load Datasets Efficiently in Pandas: A Complete Guide

How to Load Datasets Efficiently in Pandas: A Complete Guide

5
Comments
4 min read
Reliability in Data-Intensive Applications

Reliability in Data-Intensive Applications

1
Comments
3 min read
No le temas a AWS LakeFormation

No le temas a AWS LakeFormation

Comments
2 min read
Implementing Real-Time Data Processing Using Apache Flink

Implementing Real-Time Data Processing Using Apache Flink

Comments
3 min read
Boost Your Data Transfer Speed by 100x with Arrow Flight SQL in Just 3 Minutes

Boost Your Data Transfer Speed by 100x with Arrow Flight SQL in Just 3 Minutes

Comments
5 min read
Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

Comments
4 min read
Optimizing Data Lake Storage Architectures for High-Volume, High-Velocity Data

Optimizing Data Lake Storage Architectures for High-Volume, High-Velocity Data

Comments
4 min read
The Future of Big Data: Key Trends Shaping 2025

The Future of Big Data: Key Trends Shaping 2025

Comments
1 min read
Designing a Scalable Shuffle Service for Big Data on AWS

Designing a Scalable Shuffle Service for Big Data on AWS

Comments
3 min read
From Overload to Insight: Big Data in Mastery of Web Applications

From Overload to Insight: Big Data in Mastery of Web Applications

Comments
5 min read
Exploring Data Integration and the Evolution of Apache SeaTunnel Architecture

Exploring Data Integration and the Evolution of Apache SeaTunnel Architecture

Comments
4 min read
Analyzing billing information using BigQuery

Analyzing billing information using BigQuery

Comments
3 min read
Object Storage as Primary Storage: The MinIO Story

Object Storage as Primary Storage: The MinIO Story

Comments
7 min read
AWS Athena

AWS Athena

Comments
3 min read
Essential Skills Every Aspiring Data Scientist Should Acquire for Career Success (2025)

Essential Skills Every Aspiring Data Scientist Should Acquire for Career Success (2025)

Comments
3 min read
Run PySpark Local Python Windows Notebook

Run PySpark Local Python Windows Notebook

Comments
3 min read
Using DolphinScheduler API to Achieve Efficient Batch Workflow Import and Script Deployment

Using DolphinScheduler API to Achieve Efficient Batch Workflow Import and Script Deployment

6
Comments
3 min read
Data formats - how and when

Data formats - how and when

Comments
3 min read
Vector search using Alibaba Cloud inference API and semantic text

Vector search using Alibaba Cloud inference API and semantic text

Comments
10 min read
MapReduce Simplified: Understand Distributed Processing with the Same Logic as SQL

MapReduce Simplified: Understand Distributed Processing with the Same Logic as SQL

3
Comments
4 min read
When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability

When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability

Comments
5 min read
Using Apache Parquet to Optimize Data Handling in a Real-Time Ad Exchange Platform

Using Apache Parquet to Optimize Data Handling in a Real-Time Ad Exchange Platform

2
Comments
3 min read
How to Calculate the Return on Investment for Data Analytics

How to Calculate the Return on Investment for Data Analytics

5
Comments
5 min read
5 Game-Changing Habits to Master Your Data Science Journey

5 Game-Changing Habits to Master Your Data Science Journey

5
Comments
4 min read
loading...