Scaling Up With R and Apache Arrow - Bigger Data, Easier Workflows

Analyze large datasets directly from R. Scaling Up With R and Arrow provides a guide to working efficiently with larger-than-memory datasets using the arrow R package. As data grows in size and complexity, traditional data analysis methods in R often hit technical limitations. In this book, you'll learn how to overcome these hurdles without needing to set up complex infrastructure.You'll learn about the Apache Arrow project's origins, goals, and its significance in bridging the gap between data science and big data ecosystems. You'll also learn how to leverage the arrow R package to work directly with files in various formats, such as CSV and Parquet, using familiar dplyr syntax. This book explores practical topics like data manipulation, file formats, working with larger datasets, and optimizing workflows for data in cloud storage. Advanced chapters examine user-defined functions, integration with other tools like DuckDB, and extending Arrow's capabilities to work with geospatial data.Written by developers of the Arrow R package, this guide is essential for anyone looking to scale their data processing capabilities in R.

Product details

• Authors: Nic Crane, Nic Keane Crane, Jonathan Keane, Neal Richardson, Richardson Neal
• Publisher: Taylor & Francis Ltd.
• Languages: English
• Product format: Hardback
• Released: 06.05.2025
• EAN: 9781032663203
• ISBN: 978-1-0-3266320-3
• No. of pages: 146
• Subjects: Natural sciences, medicine, IT, technology > IT, data processing > Programming languages; Software Engineering, Data Mining, COMPUTERS / Computer Science, COMPUTERS / Software Development & Engineering / General, COMPUTERS / Mathematical & Statistical Software, computer science, COMPUTERS / Software Development & Engineering / Tools, Programming & scripting languages: general, Database design and theory, COMPUTERS / Data Science / Data Modeling & Design, COMPUTERS / Data Science / Machine Learning, COMPUTERS / Data Science / Data Visualization, Programming and scripting languages: general, COMPUTERS / Data Science / Data Analytics, COMPUTERS / Data Science / General, COMPUTERS / Database Administration & Management, Database design & theory, data science;data workflows;software;R;Apache Arrow;database