Skip to content

asjad99/Data-Engineering-Fundamentals

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 

Repository files navigation

Elvive

Computational Analytics Toolbox

The academic discipline of computer science emerged in the 1960s, with a focus on programming languages, compilers, operating systems, and the mathematical theories supporting these areas. Theoretical computer science courses covered finite automata, regular expressions, context-free languages, and computability. In the 1970s, algorithm studies became a significant component of the field, emphasizing the practical applications of computers.

Today, there is a fundamental shift towards a wide range of applications. Numerous factors contribute to this change, including the convergence of computing and communication technologies, the increased capacity to observe, collect, and store data in various fields, and the rise of the internet and social networks as integral parts of daily life. These developments present both opportunities and challenges for theoretical computer science. While traditional areas remain crucial, future researchers will increasingly focus on utilizing computers to extract valuable information from massive datasets generated by applications, rather than solely on solving well-defined problems. Consequently, we are developing a repertoire of techniques to address the theoretical knowledge expected to be relevant in the next 40 years, just as the understanding of automata theory, algorithms, and related topics provided an advantage in the past 40 years. One notable shift is the heightened emphasis on probability, statistics, and numerical methods.

This repository aims to explore enduring concepts and ideas that have withstood the test of time. We investigate intriguing and relatively straightforward notions that form the foundation for creating data products. We will explore mathematically rigorous definitions for some of the central problems, ideas, and algorithms for building data products. The toolbox overall, can be used for data analysis using mathematical and computational techniques. It builds upon techniques for statistical analysis, machine learning algorithms, and complex modeling. It's applied to gain insights, make predictions, or extract patterns from data.

my_library/ ├── src/ │ └── my_library/ │ ├── init.py │ ├── module1.py │ └── module2.py ├── tests/ ├── docs/ ├── setup.py ├── README.md ├── LICENSE └── .gitignore

  • Julia course
  • CS168
  • Data Science foundations

About

Data Engineering using Databricks

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages