Repository navigation

Optimize deduplication while processing held tasks - #2203

Open

rahul-privado wants to merge 39 commits into

joernio:masterfrom

rahul-privado:held-tasks-opti

Open

Optimize deduplication while processing held tasks#2203
rahul-privado wants to merge 39 commits into
joernio:masterfrom
rahul-privado:held-tasks-opti

Commits on Jan 18, 2023
- Stored groups to avoid recomputation. Brings down held task computation time to 15% of earlier ( 6X speedup )
  rahul-privado
  committed
  e62f85b
- Code betterment
  rahul-privado
  committed
  31f968e
- Removed unused function
  rahul-privado
  committed
  ecc40e8
Commits on Jan 19, 2023
- Merge branch 'master' into held-tasks-opti
  rahul-privado
  committed
  9e4042c
Commits on Jan 20, 2023
- More compact code for old
  rahul-privado
  committed
  e6b18a8
- Revert "More compact code for old"
  rahul-privado
  committed
  a7b9aea
- Cache table entry list
  rahul-privado
  committed
  0269925
- Merge branch 'master' into held-tasks-opti
  rahul-privado
  committed
  5378828
- Formatted the code
  rahul-privado
  committed
  e9b24da
Commits on Jan 24, 2023
- Merge branch 'joernio:master' into held-tasks-opti
  rahul-privado
  authored
  1457a60
Commits on Jan 25, 2023
- 1. Properly concatenated the lists to avoid missing TableEntries
  rahul-privado
  committed
  42daee6
- Removed sorting O(n^2) worst case and made it a linear search O(n) to find the max elements
  rahul-privado
  committed
  214edfc
Commits on Jan 27, 2023
- Unique hash for each TableEntry
  rahul-privado
  committed
  a252feb
Commits on Jan 30, 2023
- Lazy computation of Sha1 hash
  rahul-privado
  committed
  22f0cb1
- Merge branch 'master' into held-tasks-opti
  rahul-privado
  committed
  bbd65f0
- Reintroduced caching of table entry hashes
  rahul-privado
  committed
  9dfadd7
- Variable renaming
  rahul-privado
  committed
  16323fd
- Formatted the code
  rahul-privado
  committed
  34372f4
- Moved hash computation to a different function
  rahul-privado
  committed
  04cc73d
- Merging code improvement
  rahul-privado
  committed
  f1ef699
- Filter on max length
  rahul-privado
  committed
  e5afde1
- Filtering while appendin new list
  rahul-privado
  committed
  ee78f6b
- Accounted for new max entries
  rahul-privado
  committed
  9ebba8f
- Removed SHA/MD5 usage since it is expensive
  rahul-privado
  committed
  83dc73f
- Used minBy() instead of sorting
  rahul-privado
  committed
  d4eba26
Commits on Jan 31, 2023
- Updated group list map that was missed earlier
  rahul-privado
  committed
  b56b25f
- 1. Converted merge list to hash map
  rahul-privado
  committed
  a866227
- Better sync of the critical section
  rahul-privado
  committed
  125e30b
- Merge branch 'master' into held-tasks-opti
  rahul-privado
  committed
  901c50e
Commits on Feb 1, 2023
- Removed merge list map since it is no longer needed
  rahul-privado
  committed
  f614366
- Introduced RW lock for proper protection
  rahul-privado
  committed
  328c287
- Parallization in the outer loop
  rahul-privado
  committed
  8375599
- Removed outer loop parallelism due to race issues
  rahul-privado
  committed
  c4ce927
- Parallel group computation
  rahul-privado
  committed
  febe497
- Line formatting
  rahul-privado
  committed
  39db644
Commits on Feb 2, 2023
- Made priority computation more accurate
  rahul-privado
  committed
  5ed522d
Commits on Feb 6, 2023
- Merge branch 'master' into held-tasks-opti
  rahul-privado
  committed
  dba8d1d
Commits on Feb 7, 2023
- Merge branch 'joernio:master' into held-tasks-opti
  rahul-privado
  authored
  70a53b8
Commits on Feb 10, 2023
- Merge branch 'joernio:master' into held-tasks-opti
  rahul-privado
  authored
  3a01ade

Commits

Commits on Jan 18, 2023

Commits on Jan 19, 2023

Commits on Jan 20, 2023

Commits on Jan 24, 2023

Commits on Jan 25, 2023

Commits on Jan 27, 2023

Commits on Jan 30, 2023

Commits on Jan 31, 2023

Commits on Feb 1, 2023

Commits on Feb 2, 2023

Commits on Feb 6, 2023

Commits on Feb 7, 2023

Commits on Feb 10, 2023