{"action":"created","issue":{"url":"https://api.github.com/repos/dotnet/orleans/issues/2161","repository_url":"https://api.github.com/repos/dotnet/orleans","labels_url":"https://api.github.com/repos/dotnet/orleans/issues/2161/labels{/name}","comments_url":"https://api.github.com/repos/dotnet/orleans/issues/2161/comments","events_url":"https://api.github.com/repos/dotnet/orleans/issues/2161/events","html_url":"https://github.com/dotnet/orleans/issues/2161","id":177342622,"number":2161,"title":"Wanted: Transaction benchmark scenarios","user":{"login":"philbe","id":5748366,"avatar_url":"https://avatars.githubusercontent.com/u/5748366?v=3","gravatar_id":"","url":"https://api.github.com/users/philbe","html_url":"https://github.com/philbe","followers_url":"https://api.github.com/users/philbe/followers","following_url":"https://api.github.com/users/philbe/following{/other_user}","gists_url":"https://api.github.com/users/philbe/gists{/gist_id}","starred_url":"https://api.github.com/users/philbe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/philbe/subscriptions","organizations_url":"https://api.github.com/users/philbe/orgs","repos_url":"https://api.github.com/users/philbe/repos","events_url":"https://api.github.com/users/philbe/events{/privacy}","received_events_url":"https://api.github.com/users/philbe/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2016-09-16T04:25:00Z","updated_at":"2016-09-26T23:58:29Z","closed_at":null,"body":"@tamereldeeb and I are looking for mixed-workload transaction benchmarks that we can use to measure our implementation’s performance. It should have a few types of transactions and be representative of transaction apps that Orleans users want. Do you have any scenarios to suggest?\r\n\r\nTPC-C is the most popular transaction benchmark. But each transaction fans out to many grains, which will perform poorly compared to a classical database system, and is probably not representative of transaction apps that Orleans users want. TPC-E is too complicated and again is probably not representative.\r\n\r\nWe have one good benchmark, indexing, where a transaction updates the grain and the index over the grain’s class. We’re looking for something more complex.\r\n"},"comment":{"url":"https://api.github.com/repos/dotnet/orleans/issues/comments/249731493","html_url":"https://github.com/dotnet/orleans/issues/2161#issuecomment-249731493","issue_url":"https://api.github.com/repos/dotnet/orleans/issues/2161","id":249731493,"user":{"login":"philbe","id":5748366,"avatar_url":"https://avatars.githubusercontent.com/u/5748366?v=3","gravatar_id":"","url":"https://api.github.com/users/philbe","html_url":"https://github.com/philbe","followers_url":"https://api.github.com/users/philbe/followers","following_url":"https://api.github.com/users/philbe/following{/other_user}","gists_url":"https://api.github.com/users/philbe/gists{/gist_id}","starred_url":"https://api.github.com/users/philbe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/philbe/subscriptions","organizations_url":"https://api.github.com/users/philbe/orgs","repos_url":"https://api.github.com/users/philbe/repos","events_url":"https://api.github.com/users/philbe/events{/privacy}","received_events_url":"https://api.github.com/users/philbe/received_events","type":"User","site_admin":false},"created_at":"2016-09-26T23:58:29Z","updated_at":"2016-09-26T23:58:29Z","body":"@veikkoeeva Interesting thought. The good part is that TPC-DS 2.0 mixes updates with queries, which is probably what we want. But off hand, I don't see how to adapt it to meet our needs. The updates in TPC-DS are files, each containing updated rows of a table. AFAIK, they don't tell us the nature of transactions that generated those updated rows, so we would have to guess at the transaction workload that produced those rows. \r\n\r\nSomeone suggested OLTPBench (https://github.com/oltpbenchmark). It generates load for a lot of benchmarks. Kind of embarrassing I didn't think of that, since I know the authors well. I'd be interested to know if any of their workloads is representative of some Orleans apps."}}
{"actor":{"display_login":"philbe"}}