{"action":"created","issue":{"url":"https://api.github.com/repos/traviscrawford/spark-dynamodb/issues/9","repository_url":"https://api.github.com/repos/traviscrawford/spark-dynamodb","labels_url":"https://api.github.com/repos/traviscrawford/spark-dynamodb/issues/9/labels{/name}","comments_url":"https://api.github.com/repos/traviscrawford/spark-dynamodb/issues/9/comments","events_url":"https://api.github.com/repos/traviscrawford/spark-dynamodb/issues/9/events","html_url":"https://github.com/traviscrawford/spark-dynamodb/issues/9","id":174154076,"number":9,"title":"read_capacity_pct unused?","user":{"login":"findchris","id":1185,"avatar_url":"https://avatars.githubusercontent.com/u/1185?v=3","gravatar_id":"","url":"https://api.github.com/users/findchris","html_url":"https://github.com/findchris","followers_url":"https://api.github.com/users/findchris/followers","following_url":"https://api.github.com/users/findchris/following{/other_user}","gists_url":"https://api.github.com/users/findchris/gists{/gist_id}","starred_url":"https://api.github.com/users/findchris/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/findchris/subscriptions","organizations_url":"https://api.github.com/users/findchris/orgs","repos_url":"https://api.github.com/users/findchris/repos","events_url":"https://api.github.com/users/findchris/events{/privacy}","received_events_url":"https://api.github.com/users/findchris/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":23,"created_at":"2016-08-30T23:58:51Z","updated_at":"2016-09-23T20:46:48Z","closed_at":null,"body":"Greetings!\r\n\r\nFirst run and this library works as advertised (thanks @traviscrawford for the open source contribution 👍), except the `readCapacityPct` option doesn't appear to be respected.\r\n\r\nMy snippet:\r\n```scala\r\nval df = sqlContext\r\n  .read\r\n  .option(\"read_capacity_pct\", \"20\")  // <-- this should set usage to 20%, right?\r\n  .schema(TableSchema)\r\n  .dynamodb(TableName)\r\ndf.count\r\n```\r\n\r\nThe issue I'm seeing is I watched the read unit consumption jump to ~85%, which won't fly in a production environment.  Am I configuring the `read_capacity_pct` option correctly?\r\n\r\nFrom what I see, `readCapacityPct` gets declared but is not used elsewhere.\r\n\r\nCheers.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/traviscrawford/spark-dynamodb/issues/comments/249298370","html_url":"https://github.com/traviscrawford/spark-dynamodb/issues/9#issuecomment-249298370","issue_url":"https://api.github.com/repos/traviscrawford/spark-dynamodb/issues/9","id":249298370,"user":{"login":"findchris","id":1185,"avatar_url":"https://avatars.githubusercontent.com/u/1185?v=3","gravatar_id":"","url":"https://api.github.com/users/findchris","html_url":"https://github.com/findchris","followers_url":"https://api.github.com/users/findchris/followers","following_url":"https://api.github.com/users/findchris/following{/other_user}","gists_url":"https://api.github.com/users/findchris/gists{/gist_id}","starred_url":"https://api.github.com/users/findchris/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/findchris/subscriptions","organizations_url":"https://api.github.com/users/findchris/orgs","repos_url":"https://api.github.com/users/findchris/repos","events_url":"https://api.github.com/users/findchris/events{/privacy}","received_events_url":"https://api.github.com/users/findchris/received_events","type":"User","site_admin":false},"created_at":"2016-09-23T20:46:48Z","updated_at":"2016-09-23T20:46:48Z","body":"> Would y'all find if useful if we published the backup job we're using?\r\n\r\nYes.  AWS has their Data Pipeline stuff, but it feels more consistent to have it all in Spark.  Does this backup job happen to have a throttling mechanism built in @traviscrawford ?  ;-)"}}
{"actor":{"display_login":"findchris"}}